SPDE LIMITS OF MANY-SERVER QUEUES 



HAYA KASPI AND KAVITA RAMANAN 



Abstract. A many-server queueing system is considered in which customers with independent 
and identically distributed service times enter service in the order of arrival. The state of the 
system is represented by a process that describes the total number of customers in the system, as 
well as a measure- valued process that keeps track of the ages of customers in service, leading to 
a Markovian description of the dynamics. Under suitable assumptions, a functional central limit 
theorem is established for the sequence of (centered and scaled) state processes as the number of 
servers goes to infinity. The limit process describing the total number in system is shown to be 
an Ito diffusion with a constant diffusion coefficient that is insensitive to the service distribution. 
The limit of the sequence of (centered and scaled) age processes is shown to be a Hilbert space 
valued diffusion that can also be characterized as the unique solution of a stochastic partial 
differential equation that is coupled with the Ito diffusion. Furthermore, the limit processes are 
shown to be semimartingales and to possess a strong Markov property. 
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1. Introduction 

1.1. Background, Motivation and Results. Many-server queues constitute a fundamental 
model in queueing theory and are typically harder to analyze than single-server queues. The 
main objective of this paper is to establish useful functional central limit theorems for many-server 
queues in the asymptotic regime in which the number N of servers tends to infinity and the mean 
arrival rate scales as \( N ^ = XN — @«/N for some A > and (3 g (— oo, oo). For many-server queues 
with Poisson arrivals, this scaling was considered more than half a century ago by Erlang [7] and 
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thereafter by Jagerman |18] for a loss system with exponential service times, but it was not until 
the influential work of Halfin and Whitt [T5] that a general heavy traffic limit theorem was estab- 
lished for queues with renewal arrivals, exponential service times, normalized to have unit mean, 
and A = 1. As a result, this asymptotic regime is often referred to as the Halfin- Whitt regime. 
In contrast to conventional heavy traffic scalings, in the Halfin- Whitt regime the limiting station- 
ary probability of a positive wait is non-trivial (i.e., it lies strictly between zero and one), which 
better models the behavior of many systems found in applications. Halfin and Whitt |15j showed 
that the limit of the sequence of processes representing the (appropriately centered and scaled) 
number of customers in the system is a diffusion process that behaves like an Ornstein-Uhlcnbeck 
process below zero and like a Brownian motion with drift above zero. When /3 > 0, which ensures 
that each of the TV-server queues is stable, this characterization of the limit process was used to 
establish approximations to the stationary probability of positive wait in a queue with N servers. 
For exponential service distributions, the work of Halfin and Whitt was subsequently generalized 
by Mandelbaum, Massey and Reiman [53] to the network setting and the case of inhomogeneous 
Poisson arrivals. 

However, in many applications, statistical evidence suggests that it may be more appropriate 
to model the service times as being non-exponential (see, for example, the study of real call center 
data in Brown et al. [6] that suggests that the service times are lognormally distributed). A 
natural goal is then to understand the behavior of many-server queues in this scaling regime when 
the service distribution is not exponentially distributed. Specifically, in addition to establishing 
a limit theorem, the aim is to obtain a tractable representation of the limit process that makes 
it amenable to computation, so that the limit could be used to shed insight into performance 
measures of interest for an TV-server queue. 

In this work, we represent the state of the iV-server queue by a nonnegative, integer-valued 
process X^ that records the total number of customers in system, as well as a measure- valued 
process v( N ^ that keeps track of the ages of customers in service. This representation was first 
introduced by Kaspi and Ramanan in [22], where it was used to identify the functional strong law 
of large numbers limits or equivalently, fluid limits for these queues and was subsequently shown 
to provide a Markovian description of the dynamics (see Kang and Ramanan [20]). Under suitable 
assumptions, in each of the cases when the fluid limit is subcritical, critical or supercritical (which, 
roughly speaking, corresponds to the cases A < 1, A = 1 and A > 1), wc show (in Theorems 15.61 
and 15 .7|) that the diffusion-scaled state sequence, {(iW, J?^)}jveN obtained by centering the 
state around the fluid limit and multiplying the centered state by v~N, converges weakly to a limit 
process (X,v). Moreover, the component X is characterized as a real-valued cadlag process that 
is the solution to an Ito diffusion with a constant diffusion coefficient that is insensitive to the 
service distribution, and whose drift is an adapted process that is a functional of v t (see Corollary 
I5.13|) . As for the age process, although the Ja n > are (signed) Radon measure valued processes, 
the limit v lies outside this space. A key challenge was to identify a suitable space in which 
to establish convergence without imposing restrictive assumptions on the service distribution G. 
Under conditions that include a large class of service distributions relevant in applications such as 
phase-type, Weibull, lognormal, logistic and (for a large class of parameters) Erlang and Pareto 
distributions, we show that the convergence of v^ N ' to v holds in the space of H_2-valued cadlag 
processes, where H_2 is the dual of the Hilbert space H2. In particular, this immediately implies 
convergence of a large class of functionals of the many-server queue. In addition, we show that 
both processes are semimartingales with an explicit decomposition (see Theorem 15. 8|) and we 
characterize v as the unique solution to a stochastic partial differential equation that is coupled 
with the Ito diffusion X (see Theorem 15 . 1 If a) ) . Furthermore (in Theorem 15.1 If b)). we also show 
that the pair, along with an appended state, forms a strong Markov process. 

1.2. Relation to Prior Work. To date, the most general results on process level convergence 
in the Halfin- Whitt regime were obtained in a nice pair of papers by Reed [30 and Puhalskii and 
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Reed 29 . Under the assumptions that A = 1, the residual service times of customers in service 
at time are independent and identically distributed (i.i.d.) and taken from the equilibrium fluid 
distribution, and the total (fluid scaled) number in system converges to f , a heavy traffic limit the- 
orem for the sequence of processes {-X"^}jveN was established by Reed [3D] with only a finite mean 
condition on the service distribution. This result was extended by Puhalskii and Reed [29] to allow 
for more general, possibly inhomogeneous arrival processes and residual service times of customers 
in service at time zero that, while still i.i.d. could be chosen from an arbitrary distribution. In this 
setting, convergence of finite-dimensional distributions was established in [29], and strengthened 
to process level convergence established when the service distribution is continuous. The general 
approach used in both these papers is to represent the many-server queue as a perturbation of 
an infinite-server queue and to establish tightness and convergence using a continuous mapping 
representation and estimates analogous to those obtained by Krichagina and Puhalskii [23] for 
the infinite-server queue under similar assumptions on the initial conditions. In both papers, the 
limit is characterized as the unique solution to a certain implicit stochastic convolution equation. 
Several previous works had also extended the Halfin-Whitt process level result for specific classes 
of service distributions. Noteworthy amongst them is the paper by Puhalskii and Rciman [28], 
which considered phase-type service distributions and characterized the heavy traffic limit theo- 
rem as a multidimensional diffusion, where each dimension corresponds to a different phase of the 
service distribution. Whitt [37; also established a process level result for a many-server queue with 
finite waiting room and a service distribution that is a mixture of an exponential random variable 
and a point mass at zero. Moreover, for service distributions with finite support, Mandelbaum 
and Momgilovic [25j used a combination of combinatorial and probabilistic methods to study the 
limit of the virtual waiting time process. In addition to the process level results described above, 
interesting results on the asymptotics of steady state distributions in the Halfin-Whitt regime have 
been obtained by Jelenkovic, Mandelbaum and Momgilovic [19] for deterministic service times and 
by Gamarnik and Momgilovic [13] for service times that are lattice- valued with finite support. 

Our work serves to complement the above mentioned results, with the focus being on establishing 
tractability of the limit process under reasonably general assumptions on the service distribution 
that includes a large class of service distributions of interest. Whereas in all the above papers only 
the number in system is considered, we establish convergence for a more general state process, 
which implies the convergence of a large class of functionals of the process and not just the number 
in system. In addition, our approach leads to a new characterization for the limiting number in 
system X as an Ito diffusion, which relies on an asymptotic independence result for the centered 
arrival and departure processes (see Proposition [83]) that may be of independent interest. We also 
establish an insensitivity result showing that the diffusion coefficient depends only on the mean 
and variance of the interarrival times and is independent of the service distribution. As a special 
case, we can recover the results of Halfin and Whitt [15] and Puhalskii and Reiman [28] and (for 
the smaller class of service distributions that we consider) Reed [30]. Moreover, we allow in a sense 
more general initial conditions than those considered in Reed [30] and Puhalskii and Reed [29] , 
both of which assume that the residual times of customers in service at the initial time are i.i.d. 
This property is not typically preserved at positive times. In contrast, we establish a consistency 
property (see Lemma |9.6[) that shows that the assumptions we impose at the initial time are also 
satisfied at any positive time and our assumptions are trivially satisfied by a system that starts with 
zero initial conditions (i.e., at the fluid initial condition). As shown in Theorem 3.7 and Section 6 
of Kaspi and Ramanan [22j , starting from an empty system, the fluid limit does not reach the fluid 
equilibrium state in finite time. Therefore, the consideration of general initial conditions is useful 
for both capturing the transient behavior of the system as well as for establishing the (strong) 
Markov property for the limit process. The latter can be potentially useful as this enables the 
application of a wide array of tools available for Markov processes in general state spaces. 

The Markovian representation of the state, though infinite-dimensional, leads to an intuitive 
characterization of the dynamics, which allows the framework to be extended to incorporate more 
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general features into the model (see, for example, the extension of this framework to include 
abandonments by Kang and Ramanan in |20j and [211 )). In the subcritical case our results provide 
a characterization of the diffusion limit of the well studied infinite-server queue, which is easier to 
analyze due to the absence of a queue and, hence, of an interaction between those in service and 
those waiting in queue. A few representative works on diffusion limits of the number in system 
in the infinite-server queue include Iglehart [16] . Borovkov [5], Whitt [36] and Glynn and Whitt 
[14] . where the limit process is characterized as an Ornstein-Uhlenbeck process, and Krichagina 
and Puhalskii [33] , who provided an alternative representation of the limit in terms of the so-called 
Kiefer process. More recently, a functional central limit theorem in the space of distribution- valued 
processes was established for the M/G/oo queue by Decreusefond and Moyal [§]■ In contrast 
to the infinite-dimensional Markovian representation in terms of residual service times used in 
Decreusefond and Moyal [9] , the Markovian representation in terms of the age process that we use 
allows us to associate some natural martingales that facilitate the analysis. This perspective may 
be useful in the analysis of other queueing networks as well and has, for example, been recently 
adopted by Reed and Talreja [31] in their extension of the work of Decreusefond and Moyal [9] 
to establish infinite-dimensional functional central limit theorems for the GI/G/oo queue. The 
work |31] adopts a semi-group approach that seems to require much stronger assumptions on the 
service distribution (namely that the hazard rate function h of the service distribution is infinitely 
diffcrcntiable and h and its derivatives arc all uniformly bounded) than is imposed in our paper. 

1.3. Outline of the Paper. Section [2] contains a precise mathematical description of the model 
and the state descriptor used, as well as the defining dynamical equations. A deterministic ana- 
log of the model, described by dynamical equations that are referred to as the fluid equations, is 
introduced in Section [3] Section [3] also recapitulates the result of Kaspi and Ramanan [22] that 
shows that (under fairly general conditions stated as Assumptions [1] and [2]) the functional strong 
law of large numbers limit of the normalized (divided by N) state of the iV-server system is the 
unique solution to the fluid equations. In Section @] a sequence of martingales obtained as com- 
pensated departure processes, which play an important role in the analysis, is introduced and the 
associated scaled martingale measures are shown to be orthogonal, which allows 
one to define certain associated stochastic convolution integrals w- N \ The main results and their 
corollaries are stated in Section [5] and their proofs are presented in Section [9] The proofs rely 
on results obtained in Sections [5] [7] and [5] Section |5] contains a succinct characterization of the 
dynamics and establishes a representation (see Proposition 16.41) for d^ N \ the diffusion-scaled age 
process in the iV-server system, in terms of certain stochastic convolution integrals T-L^ N \ KS- N ^ 
and the initial data. In Section it is shown that the processes £W XW and iA N > can be 
obtained as a continuous mapping of the initial data sequence and the process T-L^ N \ Section [8] 
is devoted to establishing convergence of the martingale measure sequence {M^^n&i and the 
associated sequence {W N '}NeN of stochastic convolution integrals, jointly with the sequence of 
centered arrival processes and initial conditions (see Corollary 18 .7[) . In particular, the asymptotic 
independence property is established. Section [5] is the most technically demanding part of the 
paper. To maintain the flow of the exposition, some supporting results are relegated to the Appen- 
dix. Appendix lEl also contains the proof of a consistency result, which shows that the assumptions 
on the initial conditions are reasonable. First, in Section [1.41 we introduce some common notation 
and terminology used in the paper. 

1.4. Notation and Terminology. The following notation will be used throughout the paper, 
is the set of non-negative integers, N is the set of natural numbers or, equivalently, strictly 

positive integers, R is the set of real numbers and R+ the set of non-negative real numbers. For 
a, b G R, a V b and a A b denote, respectively, the maximum and minimum of a and b, and the 
short-hand notation a + will also be used for aVO. Given B C R, Is denotes the indicator function 
of the set B (that is, = 1 if x £ B and TLb(%) = otherwise). 
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1.4.1. Function Spaces. Given any metric space £, we denote by B{£) the Borel sets of £ (with 
topology compatible with the metric on £), and let C&(£), ACb(£) and C c {£), respectively, denote 
the space of bounded continuous functions, bounded absolutely continuous functions and the space 
of continuous functions with compact support defined on £ and taking values in the reals. We also 
let C 1 (£) and C°°(£), respectively, represent the space of real-valued, once continuously differen- 
tiable and infinitely differcntiable functions on £, C*(£) the subspace of functions in C 1 (£) that 
have compact support and C^(£) the subspace of functions in C 1 (£) that, together with its first 
derivatives, are bounded. We let Of[0, oo) denote the space of ^-valued cadlag functions defined 
on [0, oo ) and let supp(</?) denote the support of a function tp. 

We will mostly be interested in the case when £ = [0, L) and £ = [0, L) x R + , for some Le (0, oo] . 
To distinguish these cases, we will usually use / to denote generic functions on [0, L) and tp to 
denote generic functions on [0, L) x M + . By some abuse of notation, given / on [0, L), we will 
sometimes also treat it as a function on [0, L) x M + that is constant in the second variable. Recall 
that given T < oo and a continuous function / € C[0,T], the modulus of continuity Wf(-) of / is 
defined by 

(1.1) w f (6)= sup \f( t )-f(s)\, 5>0. 

s,te[0,T]:\t-s\<6 

When £ = [0, L) x R + , for some L < oo, we let C 1:1 ([0,i) x R + ) denote the space of absolutely 
continuous functions ip on [0, L) x M + for which the directional derivative ip x + <p s in the (1, 1) 
direction exists and is continuous and let C^QO, L) x R + ) (respectively, C b ([0, L) x M + )) denote 
the subset of functions ip in C 1,1 ([0,i) x M + ) such that tp, along with its directional derivative 
fx + <Ps> has compact support (respectively, is bounded). We let Ir + [0, oo) denote the space of 
non-decreasing functions / e Br[0,oo) with /(0) = 0. For L e [0, oo], L a [0,L), a > 1, and 
L°°[0, L) represent, respectively, the spaces of measurable functions / such that J, Q L . |/| Q < oo 
and the space of essentially bounded functions on [0, L). Also, L\ oc [Q, L), i = 1,2, oo, represents the 
corresponding space in which the associated property holds only locally, that is, on every compact 
subset of [0, L). The constant functions / = 1 and / = on [0, L) will be represented by the 
symbols 1 and 0, respectively. Given any cadlag, real-valued function / defined on E, we define 
II/IIt = su Pse[o,T] I/O)! for cvcr y T < co, and let WfW^ = sup s£[0 >oo) |/(s)|, which could possibly 
take the value oo. Also, for / e Dr[0,oo), we use Af(t) = f(t) — f(t—) to denote the jump of / 
at t. 

For any / e C°°[0,L), let denote the nth derivative of /. Also, let ||/|| Ho be the usual 
L 2 -norm: ||/||^ o = \\f\fo = ^ f 2 (x) dx^j , and set 

n 2 

ii/iih„ = ii/iih +E|/ w h ■ 

l— 1 

For n = 1,2, and / for which the corresponding first or second (weak) derivatives are well defined, 
we will sometimes also use the notation /' = /W and /" = f( 2 \ Note that if / e L 2 [0, oo), then 
there exists a real-valued sequence {x n } with x n — > oo and f(x n ) — > as n — > oo. Moreover, 
f 2 (xn) — / 2 (0) = 2 J Q ™ f(u)f'(u)du. Applying the Cauchy-Schwarz inequality and taking limits 
as n — > oo, this implies |/(0)| 2 < 2||/|| H \\f'\\ n < 2||/||h When combined with the relation 
f 2 (x) = / 2 (0) + 2 f(u)f'(u) du and another application of the Cauchy-Schwarz inequality, this 
yields the norm inequalities 

(1-2) l/(0)| <V2||/|| Hl , ll/ll co <2||.f|| Hl , 

which will be used in the sequel. 

For a fixed [0,L), we define S — S[0,L) (respectively, S c — <S c [0,L)) to be the vector space 
of C°° functions (respectively, C°° functions with compact support) on [0,L)) ; equipped with the 
sequence of norms ||-|| H , n — 0, 1,2,.. ., and let H„ = H„[0, L) be the completion of S relative to 
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the norm ||-||„. Moreover, let S' be the dual of S (i.e., the space of continuous linear functionals 
on S) equipped with the strong topology and likewise, let S' c be the dual of S c - For n £ N, let 
H_„ = W- n [0,L) be the dual of H„[0,L), with the dual norm defined by 

oo 
k=l 

where {e n k, k = 1, . . . ,} is a complete orthonormal system in (S, ||-||„). Each H„ is a Sobolev space 
and also a Hilbert space and it follows from Maurin's theorem (see, for example, Theorem 6.53 of 

PQ) that ll'llflj < ll'llnj an d it follows from Lemma 5 and Assertion 11 of [2] that S is a separable, 
Frechet nuclear space and consequently (see Corollary 2 and Assertion 11 of [2]), its dual S' is also 
a separable Frechet nuclear space. For v £ S' and / £ S and likewise, for v £ H_ ra and / £ H„, 
we let v{f) denote the duality pairing. 

1.4.2. Measure Spaces. The space of Radon measures on a metric space £ , endowed with the Borel 
cr-algebra, is denoted by M(£), M.p{£) is the subspace of finite measures in M(£) and M<i(£) 
is the subspace of sub-probability measures (i.e., positive measures with total mass less than on 
equal to 1) on £. For any Borel measurable function / : £ — > M that is integrable with respect 
to £ £ M(£), we often use the short-hand notation (/,£) = f £ f(x)£(dx). Recall that a Radon 
measure on £ is one that assigns a finite measure to every relatively compact subset of £ . By 
identifying a Radon measure \i £ M(£) with the mapping on C c (£) defined by f *-> one can 
equivalently define a Radon measure on £ as a linear mapping from C c (£) into R such that for 
every compact set K, C £, there exists L/c < oo such that 

I </,/*>! < L K H/IU V/ £ C c {£) with su PP (/) c fC, 
We will equip Mp(£) with the weak topology, i.e., a sequence {fi n } n eN m Mp(£) is said to converge 
to fi in the weak topology (denoted fx n A fi) if and only if for every / £ Cb{£), (/, /i n ) — > (/, //) 
as n — > co. The symbol 8 X will be used to denote the measure with unit mass at the point x and 
we will use to denote the identically zero Radon measure. When £ is an interval, say [0,L), for 
notational conciseness, we will often write M[0, L) instead of M([0, L)). Also, for ease of notation, 
given £ £ M[0, L) and an interval (a, b) C [0, L), we will use £(a, 6) and £(a) to denote ^((a, 6)) and 
^({a}), respectively. 

1.4.3. Stochastic Processes. Given a Polish space H, we denote by D^[0, T] (respectively, D^[0, oo)) 
the space of H-valued, cadlag functions on [0, T] (respectively, [0, oo)), endowed with the usual Sko- 
rokhod J\ -topology (see [4] for details on this topology). Then D^[0, T] and B-h[0, oo) are also 
Polish spaces. In this work, we will be interested in H-valued stochastic processes, especially the 
cases when H=M.,H = M F [0,L) for some L < oo, H = S'[0,L) and H = H_ n [0,L) for n= 1,2, 
and products of these spaces. These are random elements that are defined on a probability space 
(f2, J", P) and take values in O^[0,oo), equipped with the Borel cr-algebra (generated by open sets 
under the Skorokhod Ji-topology). A sequence {Z^ n >}n & ^ of cadlag, H-valued processes, with 
Z( N ^ defined on the probability space (f!'^,7'' iv ',P' JV '), is said to converge in distribution to 
a cadlag ^-valued process Z defined on (O, J 7 , P) if and only if for every bounded, continuous 
functional F : ©«[0, oo) -> R, 



lim 



F(ZW) =E[F(Z)], 



where and E are the expectation operators with respect to the probability measures TP( N > and 
P, respectively. Convergence in distribution of Z^ to Z will be denoted by Z^ =>• Z. 

2. Description of the Model 

In Section 12.11 we describe the many-server model under consideration. In Section 12.21 we intro- 
duce the state descriptor and the dynamical equations that describe the evolution of the state. 
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2.1. The iV-server model. Consider a system with N servers, where arriving customers are 
served in a non-idling, First-Come-First-Serve (FCFS) manner, i.e., a newly arriving customer 
immediately enters service if there are any idle servers or, if all servers are busy, then the customer 
joins the back of the queue and the customer at the head of the queue (if one is present) enters 
service as soon as a server becomes free. Our results are not sensitive to the exact mechanism 
used to assign an arriving customer to an idle server as long as the non-idling condition is satisfied. 
Customers are assumed to be infinitely patient, i.e., they wait in queue till they receive service. 
Servers are non-preemptive and serve a customer to completion before starting service of a new 
customer. Let ijW denote the cumulative arrival process, with E^ N ^(t) representing the total 
number of customers that arrive into the system in the time interval [0,t], and let the service 
requirements be given by the i.i.d. sequence {uj, i = —N + 1, — N + 2, . . . , 0, 1, . . .}, with common 
cumulative distribution function G. Let X™(0) represent the number of customers in the system 
at time 0. Due to the non-idling condition, the number of customers in service at time is then 
X( N \0) A N. The sequence {vi, i = —X( N '(0) AN + 1, . . . ,0} represents the service requirements 
of customers already in service at time zero, ordered according to the amount of time they have 
spent in service at time zero, whereas for i G N, Vi represents the service requirement of the ith 
customer to enter service after time 0. 

Consider the cadlag process defined by 

(2.1) Re (a) = inf {u > s : E^ N \u) > #(s)J - s, sG[0,oo). 

Note that Rg(s) represents the time to the next arrival. The following mild assumptions will be 
imposed throughout, without explicit mention. 

is a cadlag non-decreasing pure jump process with E^ N ' (0) = and almost surely, 
for t G [0,oo), E^(t) < oo and £?W(t) - E^(t-) G {0,1}; 

• The process R^ is Markovian with respect to the augmentation of its own natural filtra- 
tion; 

• The cumulative arrival process is independent of the i.i.d. sequence of service requirements 
{vj,j = -N+l,...,} and, given r£\o), (#'((),( > 0) is independent of 1^1(0) and 
the ages of the customers in service at time zero, where the age of a customer is defined 
to be the amount of time elapsed since the customer entered service; 

• G has density <?; 

• Without loss of generality, we can (and will) assume that the mean service requirement is 
1: 

(2.2) / (1-G(x))dx=[ xg(x)dx = l. 

J[0,oo) J[0,oo) 

Also, the right-end of the support of the service distribution is denoted by 

L = sup{x G [0, oo) : G(x) < 1}. 
Note that the existence of a density for G implies, in particular, that G(0+) = 0. 

Remark 2.1. The assumptions above are fairly general, allowing for a large class of arrival pro- 
cesses and service distributions, and this model is sometimes referred to as the G/GI/N queueing 
model. When £?W is a renewal process, R^^ is simply the forward recurrence time process, 
the second assumption holds (see Proposition V.1.5 of Asmussen [3]) and the model corresponds 
to a GI/GI/N queueing system. However, the second assumption holds more generally such as, 
for example, when E^ N > is an inhomogeneous Poisson process (see, for example, Lemma II. 2. 2 of 
Asmussen [3]). 

The sequence of processes {R^\ E^ N \ X^ N \0), v i7 i = —N+l, . . . , 0, 1, . . .}jvgn are all assumed 
to be defined on a common probability space (fi,.F,P) that is large enough for the independence 
assumptions stated above to hold. 
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2.2. State Descriptor and Dynamical Equations. As in the study of the functional strong 
law of large numbers limit for this model, which was carried out in Kaspi and Ramanan |22j , we 
will represent the state of the system by the vector of processes (R^ , X W, v^), where 
determines the cumulative arrival process via (|2.1I) . X^ N '(t) € Z + represents the total number of 
customers in system (including those in service and those waiting in queue) at time t and v[ N ^ is 
a discrete, non-negative finite measure on [0, L) that has a unit mass at the age of each customer 
in service at time t. Here, the age of the jth customer is (for each realization) a piecewise 
linear function that is zero till the customer enters service, then increases linearly while in service 
(representing the time elapsed since service began) and then remains constant (equal to its service 
requirement) after the customer completes service and departs the system. In order to describe 
the state dynamics, we will find it convenient to introduce the following auxiliary processes: 

• the cumulative departure process D^ N \ where D^ N \t) is the cumulative number of cus- 
tomers that have departed the system in the interval [0,t]; 

• the process K^ N \ where K^ N \t) represents the cumulative number of customers that have 
entered service in the interval [0,i\. 

A simple mass balance on the whole system shows that 

(2.3) dW± X W(p)-xW +E W 

Likewise, recalling that (1, v^ N >) — u^ N '[0, L) represents the total number of customers in service, 
an analogous mass balance on the number in service yields the relation 

(2.4) = (1> U W) _ (i, U W) + D W. 
For j G N, let 

ef ] =inf{s>0:if (JV) (s) > j}, 

with the usual convention that the infimum of an empty set is infinity, and note that 8^ denotes 
the time of entry into service of the jth customer to enter service after time 0. In addition, for 
j = -iM (0) A N+ 1, . . . , 0, set e\ N) = -a^ N} (0) to be the amount of time that the jth customer 
in service at time has already been in service. Then, for t € [0, oo) and j = -IW(0) A N + 
1, . . . , 0, 1, . . ., the age process is given explicitly by 



(2.5) af\t) 



V0 if t-ef ] <Vj, 



othc 



rwise. 



Due to the FCFS nature of the service, (t) is also the highest index of any customer that has 



entered service and ([23]) implies that for j > K^(t), e\ N) > t and a\ N \t) = 0. The measure 



can then be expressed as 



K' N \t) 



( 2 - 6 ) V t N) - d a l - N \t) ll {a^\t)<v ] }^ 

, = -(l,,< N) > + l 

where S x represents the Dirac mass at the point x. The non-idling condition, which stipulates that 
there be no idle servers when there are more than N customers in the system, is expressed via the 
relation 

(2.7) N- (l.i/W) = [N-XW}+- 

For future purposes note that (|2.3|) . (|2.4j) and (|2.7j) . together with the elementary identity x— x\/0 = 
x A 0, imply the relation 

(2.8) = XW an- 1^(0) A N + D^ N) . 
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Note that (1,^ (JV) ) < N because the maximum number of customers in service at any given 
time is bounded by the number of servers. In addition, if the support of w lies in [0, L) then 
it follows from ([23]) and (EH)]) that takes values in M F [0,L) for every t £ [0, oo). Thus, the 
state of the system is represented by the cadlag process (Rg , X^ N \ v^), which takes values 
in x M.p[0,L). For an explicit construction of the state that also shows that the state and 
auxiliary processes are cadlag, see Lemma A.l of Kang and Ramanan 20J. The results obtained 
in this paper are independent of the particular rule used to assign customers to stations, but for 
technical purposes we will find it convenient to also introduce the additional "station process" 
<jW = (<7j N \j e {— N + 1, . . . ,0} U N). For each t € [0,oo), if customer j has already entered 

service by time t, then <Tj(t) is equal to the index i 6 {1, ...,JV} of the station at which 
customer j receives/received service and a^ N \t) = otherwise. Finally, for t £ [0,oo), let 
be the cr-algbera generated by {i?^ V) (s),a^ JV) (s),CTj Ar) (s), j e {-N, . . . , 0} U N, s G [0,t]}, and let 
{•7"t , t > 0} denote the associated right continuous filtration that is completed (with respect to 
P) so that it satisfies the usual conditions. Then it is easy to verify that (R^\ X^ N \ i/W) is 
{J-" t }-adapted (see, for example, Section 2.2 of Kaspi and Ramanan [22]). In fact, as shown in 
Lemma B.l of Kang and Ramanan [2D], {(^(t),!^'^), v[ N) ), T { t N) , t > 0} is a strong Markov 
process. 

Remark 2.2. The assumed Markov property of iig with respect to (the completed, right contin- 
uous version of) its natural filtration and the independence properties of E^ N > assumed in Section 
!2.1l together imply that for any t e [0, oo), given R^\t) the future arrivals process {E^ N \s), s > t} 
is independent of . 

3. Fluid Limit 

We now recall the functional strong law of large numbers limit or, equivalently, fluid limit 
obtained in [22]. The initial data describing the system consists of E^ N \ the cumulative arrivals 
after zero, X^ N \0), the number in system at time zero, and Vq N \ the age distribution of customers 
in service at time zero. The initial data belongs to the following space: 

(3.1) 2o = {(f,x,p) G I R+ [0,oo) x R+ x M<i[0,L) : 1- = [1-*]+} , 

where Ir + [0,oo) is the subset of non-decreasing functions / € ID>k + [0,oo) with /(0) = 0. Assume 
that lo is equipped with the product topology. Consider the "fluid scaled" versions of the processes 
H = E,X,K,D and measures H = v defined by 

—IN) ffW 

(3-2) H (N) = — , 

and let 

R ( E\t) = R^\EW(t)), ie[0,oo), 
for N £ N. The fluid results in [22J were obtained under Assumptions [1] and [2J below. 

Assumption 1. There exists (E,Xq,Vq) € Tq such that, as N — > oo, E\X (0)] — > E[A(0)], 
E[E (i)] — > E,[E(t)} and, almost surely, 

(E ,x K ') ->• [E, x ,v Q ) inlo. 

Next, recall that G has density g, and let h denote its hazard rate: 

(3.3) h{x) = l-GixY xG ^ L ^ 
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Observe that h is automatically locally integrable on [0, L) because for every < a < b < L, 

(3.4) f h(x) dx = ln(l - G{a)) - ln(l - G{b)) < oo. 

J a 

However, h is not integrable on [0,L). In particular, when L < oo, h is unbounded on (l',L) for 
every £' < L. 

Assumption 2. At least one of the following two properties holds: 

(a) There exists £' < oo such that h is bounded on {£' ,oo); 

(b) There exists £' < L such that h is lower- semicontinuous on (£',L). 

Note that Assumption [Ha) automatically implies that L = oo. In Proposition 16.11 (see also 
Theorem 5.1 of |22j ) we provide a succinct description of the dynamics of the A-server system 
in terms of certain integral equations. Here, we first introduce the deterministic analog of these 
equations, which we refer to as the fluid equations. 

Definition 3.1. (Fluid Equations) The cadlag function (X,V) defined on [0, oo) and taking 
values in R + x M<![0,L) is said to solve the fluid equations associated with (E,xo,uq) £ Iq if and 
only if X(Q) = x and for every t € [0, oo), 

(3.5) / (h,V s ) ds < oo 

Jo 

and the following relations are satisfied: for every ip £ ^'"""([O, L) x R+), 

(3.6) (tf(;t),V t ) = (ip(;0),V ) + / (lf a (;s) + tp x (',s),V s )ds 

Jo 

(h(-)tp(-,s),V s }ds+ / tp(0,a)dK(a), 

J[0,t] 



(3.7) X(t) = X(0)+E(t)- (h,V s )ds 

Jo 

and 

(3.8) l-(l,F t ) = [l-X(t)} + , 
where 

(3.9) K{t) - (L,V t ) - (1,V ) + f (h,V a ) ds. 

Jo 

We now recall the result established in Kaspi and Ramanan (55] (see Theorems 3.4 and 3.5 
therein), which shows that under Assumptions [T] and [2l the fluid equations uniquely characterize 
the functional strong law of large numbers or mean-field limit of the TV-server system, in the 
asymptotic regime where the number of servers and arrival rates both tend to infinity. 

Theorem 3.2 (Kaspi and Ramanan [22]). Suppose AssumptionsUiand&are satisfied and (E, A(0),Fo 
Iq is the limit of the initial data as stated in Assumption [7J Then there exists a unique solution 

(X,77) to the associated fluid equations iff.Jp -i HO]) and, as N — > oo, (X^ ^F^) converges al- 
most surely to (A, 77). Moreover, (A, 77) satisfies the non-idling condition i3.8\) and, for every 
f£C b (R+), 



(3.10) / f(x)V t (dx) = f f(x + t) 1 G{ * + t) V (dx) 

J[0,M) J[0,M) 1 _ 



where K satisfies the relation 



+ f(t-s)(l-G(t-s))dK(s), 
/[o,t] 
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Remark 3.3. The fluid limit will be said to be critical if X(t) = 1 for all t € [0, oo). In addition, it 
will be said to be subcritical (respectively, supercritical) if for every T € [0, oo), sup te j T j X(t) < 1 
(respectively, inffefo t] X(t) > 1). Although, in general, the fluid limit may not stay in one regime 
for all t and may instead experience periods of subcriticality, criticality and supercriticality, for 
many natural choices of initial data, such as either starting empty or starting on the so-called 
"invariant manifold" of the fluid limit, the fluid limit does belong to one of these three categories. 
Specifically, if we define the "invariant" fluid age measure to be 

(3.11) v m (dx) = (l-G(x))dx, xe[0,L), 

then it follows from Remark 3.7 and Theorem 3.8 of Kaspi and Ramanan [35] that the fluid limit 
associated with the initial data (1, 1,17*) is critical, the fluid limit associated with the initial data 
(l,a,X7*) for some a > 1 is supercritical, and if the support of G is [0,oo), then the fluid limit 
associated with the initial data (Al, 0, 0) is subcritical whenever A < 1. A complete characterization 
of the invariant manifold of the fluid in the presence of abandonments can be found in [21j . 

4. Certain Martingale Measures and their Stochastic Integrals 

We now introduce some quantities that appear in the characterization of the functional central 
limit. The sequence of martingales obtained by compensating the departure processes in each 
of the A^-server systems played an important role in establishing the fluid limit result in |22j . 
Whereas under the fluid scaling the limit of this sequence converges weakly to zero, under the 
diffusion scaling considered here, it converges to a non-trivial limit. This limit can be described in 
terms of a corresponding martingale measure, which is introduced in in Section [4. II In Scction [4.2l 
certain stochastic convolution integrals with respect to these martingale measures are introduced, 
which arise in the representation formula for the centered age process in the iV-server system (see 
Proposition l6.4[) . Finally, the associated "limit" quantities are defined in Section |4~31 The reader is 
referred to Chapter 2 of Walsh [35] for basic definitions of martingale measures and their stochastic 
integrals. 

4.1. A Martingale Measure Sequence. Throughout this section, suppose that ) 
is an 2o _va lued random element representing the initial data of the A^-server system, and let 
(R { z\x( N \v( N *>) be the associated state process described in Section |2~21 For any measurable 
function ip on [0,L) x R + , consider the sequence of processes {Qp }jvgN defined by 

K<- N \t) 

(4.1) gw ( t)= £ £ V^^^^c^l^W.-) 

se[o,t] J - = _ (1)!/ W )+ i 1 J 

for JVeN and t € [0, oo), where and a*- are, respectively, the cumulative entry into service 

process and the age process of customer j as defined by the relations (|2.4I) and (I2.5[) . Note from 
(I2.5[) that the jth customer completed service (and hence departed the system) at time s if and 
only if 

±a ( . N \s-)>0 and l a f\s+) = 0. 
at J at J 

Thus, substituting ip = 1 in (|4.1[) . we see that Q± is equal to D^ N \ the cumulative departure 

process of (|2 .3|) . Moreover, for e N and every bounded measurable function ip on [0, L) x [0, oo), 

consider the process A^p 1 ' defined by 

(4.2) 4 W > (t) = [[ [ <p{x, s)h{x) (dx)) da, t e [0, oo), 

JO \J[0,L) ) 

and set 

(4.3) MW = QW-AW. 
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It was shown in Corollary 5.5 of Kaspi and Ramanan [22j that for all bounded, continuous functions 

] { V N \ and that 



ip defined on [0,L) x [0,oo), is the {J" t ^-compensator of Qp, and that is a cadlag 



{ j\ N ^ }-martingale (see also Lemma 5.2 of Kang and Ramanan [3D] for a generalization of this 
result to a larger class of ip). Moreover, from the proof of Lemma 5.9 of Kaspi and Ramanan [22 , 
it follows that the predictable quadratic variation of M^' takes the form 

(4.4) (MM) t = A$>(t) = £ y^^(x)h(x)uW(dx)J ds, t€ [0,oo). 

Now, for B e B[Q, L) and t £ [0, oo), define 
(4-5) M[ N \B) = Mi N J(t) = Q[ N J(t) - Aff(t). 

Let Bq[0, L) denote the algebra generated by the intervals [0, x], x £ [0, L). It is easy to verify that 
.A/fW = {/Af (B), F^ N \t > 0,5 £ B o [0,L)} is a martingale measure (for completeness, a proof 
is provided in Lemma [A. II of the Appendix). We now show that A4^ N ' is in fact an orthogonal 
martingale measure (see page 288 of Walsh [35 for a definition). Essentially, the orthogonality 
property holds because almost surely, no two departures occur at the same time. First, in Lemma 
14. II below, we first state a slight generalization of this latter property, which is also used in Section 
18.21 to establish an asymptotic independence result. Given r,s £ [0, oo), let D^ N '' r (s) denote the 
cumulative number of departures during (r, r + s) of customers that entered service at or before 
r. In what follows, recall that the notation A/(t) = f(t) — fit—) is used to denote the jump of a 
function / at t. 

Lemma 4.1. For every N £ N, P almost surely, 

(4.6) AX>W(t)<l, fe[0,oo), 
and 

(4.7) A#)(r + s)ADW' r (s) = 0, r £ [0, oo). 

sS[0,oo) 

We relegate the proof of the lemma to Section IA.2I and instead, now establish the orthogonality 
property. 

Corollary 4.2. For each N £ N, the martingale measure M {N) = {M\ N \B), T^ N) ; t > 0, B £ 
Bq[0,L)} is orthogonal and has covariance functional 

(4.8) f(B,B) = (^W(B) 1 #)(B)) ( = Ai N J nB (t) 



h(x)vW(dx)) ds 



BnB 



forB,B£B [0,L). 

Proof. In order to show that the martingale measure M.( N > is orthogonal, it suffices to show 
that for every B,B € B Q [0,L) such that B n B = 0, the martingales {M.[ N \B);t > 0} and 
{M-t (B); t > 0} are orthogonal or, in other words, that 

(4.9) BnB = =>> (M w (B),M p,) (B))=0. 

Here, (•, •) represents the predictable quadratic covariation between the two martingales. Fix two 
sets B,B £ B [0,L) with BOB — 0. By Lemma 5.2 of Kang and Ramanan [20], M W (B) = M^J 
and M. ^ (B) = are martingales that are compensated sums of jumps, where the jumps occur 

at departure times of customers whose ages lie in the sets B and B, respectively. Since, by (|4.6p 
of Lemma 14.11 there are almost surely no two departures that occur at the same time, it follows 
that almost surely, the set of jump points of Ad^ N \B) and Ad^ N '(B) are disjoint. By Theorem 
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4.52 of Chapter 1 of Jacod and Shiryaev [17], it then follows that the martingales are orthogonal 
and (14. 9[) holds. Combining (|4.9[) with (|4.4[) and the biadditivity of the covariance functional, we 
then obtain (13~51l, □ 



Due to the orthogonality property established in Corollary 14.21 we can now define stochastic 
integrals with respect to the martingale measure M^ N \ Since E[A^ (T)] < oo by Lemma 5.6 of 
Kaspi and Ramanan [22] and u^ N ^ is a non-negative measure, the stochastic integral is defined for 
the space of deterministic, continuous and bounded functions on [0, L) x [0, oo) (it is in fact defined 
for a larger class of so-called predictable integrands satisfying a suitable integrability property, see 
page 292 of Walsh [35 ). Moreover, by Theorem 2.5 on page 295 of Walsh [35], it follows that for 
all bounded and continuous ip, the stochastic integral {m\ N \p){B) 1 {J 7 ^}; t > 0, B £ Bq[0,L)} 
of tp with respect to is a cadlag orthogonal martingale measure with covariance functional 

(4.10) (M w (<p)(B),M w (v)(B))t = ! (f v(x,8)$(x,8)h{x)vW(dx)) ds 

Jo \JBnB J 

for bounded, continuous tp, tp and B,B E Bq[0, L). When B = [0, L), we will drop the dependence 
on B and simply write 

Remark 4.3. For ip £ Cb([0,L) x K+), the stochastic integral J\4^ N \tp) admits a cadlag version. 
Indeed, the cadlag martingale defined in (|4.3|) is a version of the stochastic integral {tp). 

It was shown in Lemma 5.9 of Kaspi and Ramanan [22) that 

—(AO — - 

in the space of cadlag finite Radon measure valued processes. Therefore, consistent with the 
diffusion scaling (|5.1I) . we set 

(4.11) jQW = MiN) 



N 

It is clear from the above discussion that each is an orthogonal martingale measure with 

covariance functional 



Qi N) (B,B)= [ ( [ h(x)vi N \dx)) ds, 
Jo \JBnB / 



and that for any ip in a suitable class of functions that includes the space of bounded and continuous 
functions, the stochastic integral M^ N \ip) is a well defined cadlag, orthogonal {J 7 ^} martingale 
measure. Moreover, for every bounded, continuous tp,<p and t G [0, oo), 

(4.12) (M( N Hv),M {N) (0))t = I [ / V (x,sMx,s)h(x)vi N \dx)) ds. 

Jo \"'[ > L ) / 



4.2. Some Associated Stochastic Convolution Integrals. In Proposition 16.41 we show that 
the stochastic measure- valued process {v[ N \t > 0} that describes the ages of customers in the 
./V-server system admits a convenient representation that is similar to the representation (|3.10p for 
its fluid counterpart {V t , t > 0}, except that it contains an additional stochastic term involving the 
following stochastic convolution integral. For N E N, tp G Cfe([0, L) x [0, oo)) and t £ [0, oo), define 

(4.13) Hf\tp)= J J tp(x + t-s,s) 1 - S) {dx , ^ 

[O.L)x[0,t] 

where the latter stochastic integral with respect to is well defined because is an 

orthogonal martingale measure and the function {x, s) ip(x + t — s,s)(l — G(x + t — s))/(l — G(x)) 
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lies in C&([0, L) x R+) for all ip € Cfe([0, L) X The scaled version of this quantity is then defined 
in the obvious manner: for N £ N, ip £ Cb{[0,L) x [0,oo)) and t £ [0,oo), let 

(4.14) H[ N \V)= J J Vix + t-s,*) 1 - ^ g + * ~ S) (dx, ds). 

[0,i)x[0,t] 

4.3. Related Limit Quantities. We now define some additional quantities, which we subse- 
quently show (in Corollaries l8.3l and l8.7[) to be limits of the sequences {.M^j-jveN and {W n '}n&^- 
Fix a probability space (fi, J", P) and, on this space, let M = {M t {B),B £ B o [0,L),t £ [0, oo)} 
be a continuous martingale measure with the deterministic covariance functional 

(4.15) Qt(B,B) = (M(B),M(B)) t = f If l BnS (x)h(x)V s (dx) ) ds 

Jo \J[o,L) J 

for t £ [0, oo). Thus, M. is a white noise. Let denote the subset of continuous functions on 
[0,L) x [0, oo) that satisfies 

(4.16) / / tp 2 (x, s)h(x)V s (dx) ds < oo, t e [0, oo). 
Jo \J[o,L) J 

Note that Cr^ includes, in particular, the space of bounded and continuous functions. For any 

such ip £ CjQ-, the stochastic integral A4^ N \ip) is a well defined cadlag, orthogonal {Tt,t > 0} 
martingale measure (see page 292 of Walsh [35] for details). For any <p £ C-q and t € [0, oo), the 

stochastic integral of 99 with respect to .M on [0,L) x [0,i], denoted by 



(4.17) M t (ip)= j J <p(x,s)M{dx,ds), 

[0,L)x[0,t] 

is well defined. Moreover, because A4 is a continuous martingale measure, -M(</?) has a version 
as a continuous real-valued process. In fact, as Corollary 18.31 shows, A4 admits a version as a 
continuous H_2-valued process. 

Next, for t £ [0,oo) and / £ Cb[0, L), let Ht(f) be the random variable given by the following 
convolution integral: 

(4.18) H t (f)= J J fix + t-s) 1 ' * * ~ S) M(dx, ds). 

[0,i)x[0,i] 



It is shown in Lemma l8.6l that if / is bounded and Holder continuous then the real-valued stochastic 
process %{f) = {Ht{f),t > 0} admits a continuous version, and that % also admits a version as a 
continuous H_2-valued process. 

In order to write the convolution integrals in a more succinct fashion, we introduce the family 
of operators {^t, t > 0} defined, for t > and (x, s) £ [0, L) x [0, 00), by 

(4-19) (* t /) (x, s) = f{x +(t- ^ + ) 1 ~ G [ X _ + a {x ] S)+ ^ 

for bounded measurable /, where recall (t — s) + = max(t — s, 0). Each operator *S? t maps the 
space of bounded measurable functions on [0, L) to the space of bounded measurable functions on 
[0, L) x [0, 00) and we also have 

(4.20) sup U^ML^IML. 

te[o,cx>) 

We can then write T-L and H^ N \ respectively, in terms of M. and as follows: 

(4.21) Htif) = Mt(9 t f), H ( t N) (f)=Mi N) (* t f), t>0. 
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5. Main Results 



The main results of the paper are stated in Section 15.31 They rely on some basic assumptions 
and the definition of a certain map, which are first introduced in Sections 15. f I and 15.21 respectively 
Corollaries of the main results are discussed in Section 15.41 



5.1. Basic Assumptions. We now state our assumptions on the arrival processes and initial 
conditions. For Y = E, Xq, v, X, K , let Y be the corresponding fluid limit as described in Theorem 
3.21 For N G N, the diffusion scaled quantities Y( N > are defined as follows: 



(5.i) y^ = Vn(y {n) -y 



For simplicity we restrict the arrival processes to be either renewal processes or time- inhomogeneous 
Poisson processes. 

Assumption 3. The sequence {.EJWj-jveN of cumulative arrival processes satisfies one of the 
following two conditions: 

(a) there exist constants X,a 2 € (0, oo) and j3 6 K, such that for every JV e N, E^ IS 
a renewal process with i.i.d. inter-renewal times {C/ ^}jeN that have mean 1/A^ and 
variance (a 2 / A) / '(X^) 2 , where 

(5.2) X {N) = XN- /3VN. 

(b) there exist locally integrahle functions A and (3 on [0, oo) such that for every 
is an inhomogeneous Poisson process with intensity function 

(5.3) X (N) (t) = \(t)N- P(t)y/N, te[0,oo). 

Remark 5.1. Let A and j3 be the locally integrable functions defined in Assumption [3] (which 
are constant if Assumption [3(a) holds) and let cr(-) be the locally square integrable function that 
equals the constant Va 2 if Assumption [3][a) holds, and equals \/A(-) if Assumption |3](b) holds. 
Then, given a standard Brownian motion B, the process E given by 

(5.4) E(t)= [ a(s)dB(s)- [ f3(s)ds, ie[0,oo), 

JO Jo 

is a well defined diffusion and therefore a semimartingale, with J Q er(s) dB(s), t > being the local 
martingale and J* b(s) ds, t > 0, the finite variation process in the decomposition. If Assumption 
[3] holds then it is easy to see that E in Assumption Q] is given by E(t) = f X(s) ds, t > 0, and 
E^ N > =>■ E as N — > oo (a proof of the latter convergence can be found in Proposition 18.41 which 
establishes a more general result). 

We now impose a technical condition on the service distribution, which is used mainly to estab- 
lish the convergence of W N '(f) to T-L{f) in 2?r[0,oo) for Holder continuous / in Section [5] 

Assumption 4. For every x <G [0, L), the function from [0, L) to [0, 1] that takes y i-> (1 — G(x + 
y))/(l — G(x)) is Holder continuous on [0, oo), uniformly in x, i.e., there exist Cg < oo and 
7g € (0, 1) and 5 > such that for every x G [0, L) and y, y' € [0, L) with \y — y'\ < 5, 

(5-5) lGiX+ , y) -^ + y ' )l <C G \y-yV^ 

1 — G{x) 

Remark 5.2. As shown below, Assumption |4] is satisfied if either h is bounded, or if there exists 
Iq < oo such that sup^gr^ ^ h(x) < oo and G is uniformly Holder continuous on [0,L). The 
hazard rate function h is locally integrable, but not integrable, on [0, L). Thus, if h is bounded 
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(cither uniformly or on [£o, oo) for some Iq < oo) it must be that L = oo. Under the first condition 
above, for any x, y, y' £ [0, oo), y < y' , 



G(x + y) - G(x + y') 



1 - G(x) 



v g(x + u) 



du < 



h{u)du<\\h\\ 00 \y-y'\, 



1 - G(x) 

and so Assumption 2] is satisfied. On the other hand, if there only exists £o < oo such that 
sup 2 , 6 ^ 0jOO ) h{x) < oo, but G is uniformly Holder continuous on [0, oo), with constant C < oo and 
exponent 7 > 0, then straightforward calculations show 



G(x + y) - G(x + y') 



1 - G{x) 



< max 



C 



l-G(£ a ) 

and once again Assumption 2] is satisfied. A relatively easily verifiable sufficient condition for G to 
be uniformly Holder continuous is that g £ L 1+Q for some a > (recall that since g is a density, 
we automatically have ggL 1 ; thus the latter condition imposes just a little additional regularity 
on g). Indeed, in this case, by Holder's inequality, 

rv 



\G(x)-G(y)\ 



g(u) du 



<N| T , 1+ « (y-*r /(1+Q) , 



and so G is uniformly Holder continuous with exponent 7 = + a) < 1. 

Now, given s > 0, recall that represents the (scaled and centered) initial age distribution 
at time s, and define 



*r(/) 



[0,1) 



f(x + t) 



l-G(x + t) , 
1-G(x) ' 



(da;), /£C40,I),t>0. 



{5^° (/), i > 0} plays an important role in the analysis because it arises in the representation for 
(f,v( N ^) given in Proposition 16.41 In order to write S" 3 ' more concisely, it will be convenient to 
introduce a certain family of operators. For t £ [0,oo), define 

1 - G(x + t) 



(5.6) 



($t/)(i) =f(x + t)- 



x e [0,L) 



l-G(x) ' 

Each $ t maps the space of (bounded) measurable functions on [0, L) into itself and 



(5.7) 



sup ||$t/IL < H/ll 
te[o,oo) 



Moreover, for future purposes, we also note that {$ t , t > 0} defines a semigroup, i.e., $0/ = / and 

(5.8) $t(®sf) = $t+sf, s,t>0, 

and, recalling the definition (|4. 19|) of the family of operators {^t,t > 0}, it is easily verified that 
for every bounded, measurable function / on [0, L) and s, t > 0, 

(5.9) (*.*t/)(a:, u) = (*,+t/)(x, u), (x, u) £ [0, L) x [0, s]. 
We can now rewrite S" s in terms of the operators t > 0, as follows: 

(5.10) 5f^ ) (/) = ($ t /,P< JV )), 8 ,t>0. 

Since G is continuous, it is clear from (15.71) that $ t / € Cf,[0, L) when / e Cb[0,L) and hence, 

v (N > 

{S t (/), / S Ci[0, i), t > 0} is a well defined stochastic process. 

Remark 5.3. Since Vq N ^ is a signed measure with finite total mass bounded by y/~N, it can be 
easily verified that almost surely for / e ii, by the norm inequality (jl.2p , 

K/,^)l<2v / iV||/|| 0o <2ViV||/|| Hi . 
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Moreover, if Assumption 0] holds calculations similar to those in Remark 15.21 the norm inequality 
(|1.2|) and the Cauchy-Schwarz inequality show that for / € Hi and < s < t < oo, 

\sf } (/) - s?° N) (f)\ < c G (t - s y° H/iu + ||/|| Ho (t - s) 1 ' 2 < (2c G + 1) ||/|| Hi \t - sp^ 1 / 2 . 

— (iV) 

This shows that for every N £ N, S"° is a cadlag process that almost surely takes values in H_i. 

We now consider the initial conditions. We impose fairly general assumptions on the initial 
age sequence so as to establish the Markov property for the limit process. As shown in Lemma 
19. 6( these conditions are consistent in the sense that they are satisfied at any time s > if they 
are satisfied at time 0. In addition, they are trivially satisfied if each iV-server system starts 
precisely at the fluid limit, i.e., if Pq N ^ = for every N. The reader may prefer to make the latter 
assumption on first reading to avoid the technicalities in the statement of this assumption. To 
motivate the form of the assumptions, first note that the total variation of the sequence of finite 
signed measures {Pq }n&N tends to infinity as N — > oo, and so it is not reasonable to expect the 
sequence to converge in the space of finite or Radon measures. Instead, we impose convergence 
in a slightly different space. As observed in Remark 15.31 Pq N ^ can be viewed as an HLj-valued 

(and therefore H_2-valued) random element and under Assumption 21 {S t " , t > 0} is a cadlag 

v (N) 

H_i-valued stochastic process and {S t ° (l),t > 0} is a cadlag real-valued process (see Section 
11.4.11 for a definition of these spaces). 

Assumption 5. There exists an W-valued random variable Xq and a family of random variables 
{po{f)if € -4Cb[0, L)}, all defined on a common probability space, such that 

(a) Vq admits a version as an M.-2-valued random element; 

(b) For f e AC b [0, L), given 

(5-11) Sf°(f) = % ($«/) = vo (/(■ + 1) 1 1%^ ) ■ *>°> 

{St°(f),f G ACb[0, L),t > 0} is a family of random variables such that {S"°,t > 0} 
admits a version as a continuous M—2-valued process, {S""(l),t > 0} admits a version 
as a continuous M.-valued process and, for every t > almost surely, f i— > S"° (/) is a 
measurable mapping from ACb[0,L) C Cf,[0, L) i-> M (both equipped with their respective 
Borel a-algebras); 

(c) as JV -> oo, (3 { Q N) ,^ N) ,S v ° N \s F ° N \l)) => (x ,^o,5 ?0 ,5 ?0 (l)) m R x H_ 2 x V M _ 2 [0, oo) x 
2? K [0,oo). 

For some results, we will require the following strengthening of Assumption [5] 

Assumption \E\ Assumption^ holds and in addition, 

(d) Suppose that ip € C&([0, L) x [0, oo)) is such that for every r > 0, x i— > ip(x,r) is ab- 
solutely continuous and, for every T < oo, Lp x {-,-) is integrable on [0, L) x [0,T] and 
x h- > J tp(x,r)dr is Holder continuous. Then Y-almost surely, r i— >• Pq ($ r i^?(-, r)) is mea- 
surable and for every t > 0, 

(5.12) / 9 (<S> r ip(;r)) dr =P ( [ <S> r tp(-,r) dr 



Now, let (fl, F, P) be a common probability space that supports the martingale measure A4 
introduced in Section 14. 3[ the standard Brownian motion B of Remark 15. 1[ the family of random 
variables Po(f), f € ACb[0,L), and the random variable xq of Assumption [5] such that Ai,B 
and (xo,Po(f), f € ACb[0, L)) are mutually independent. Let J-q be the cr-algebra generated by 
{x ,P (f),f e AC b [0,L), and for t > 0, let f t = J V cr(B s , M s , s e [0,t]). Then for t > 0, Sf°(f), 
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/ G ACb[0,L), (and, in particular, <S t I/ °(l)) are all well defined J-o-measurable random variables, 
and {E t , A4 t )t>o are {^ t}t>cr a( iapted stochastic processes. The description of the iV-server model 
listed prior to Remark |2 . 1 1 assumes that for each N G N, given R { e } {0), £ (jv) is independent of the 
initial conditions v^ N ^ and X^ N \0). Together with Assumptions El [5] and the fact that R^\o) — > 
almost surely as N — > oo, this implies that as N — > oo, 

(5.13) ^^,5^,5^(1)) =s> (B, so, 5^,5^(1)) 
in 2? R [0,oo) x M x H_2 X £>h_ 2 [0,oo) x Pr[0,oo). 

5.2. The Centered Many-Server Map. We introduce a map, which we refer to as the centered 
many-server map, which will be used to characterize the limit. Let 2?r[0, oo) be the subset of 
functions / in 2?r[0,oo) with /(0) = 0. The input data for this map lies in the following space: 

% = X>g[0,oo) x R x X> R [0,oo). 

Definition 5.4. (Centered Many-Server Equations) Let X G 2?k + [0,oo) be fixed. Given 
(E,xq,Z) G Iq, we say that (K,X,v) G P^[0,oo) x 2?k[0,oo) 2 solves the centered many-server 
equations (henceforth, abbreviated CMSE) associated with X and (E,x ,Z) if and only if for 
t G [0,oo), 

(5.14) v(t) = Z(t)+K(t)- [ g(t-s)K(s)ds, 

Jo 

(5.15) K(t) = E(t) + x Q - X{t) + v{t) - v(0) 
and 

f X(t) if X_(t) < 1, 

(5.16) v(t) = { X(t)A0 if£(t) = l, 

[ if X(t) > 1. 

Note that this definition automatically requires that E(0) — K(0) = 0, X(0) = xq and ^(0) = 
v(0), which equals xo, x A or 0, depending on whether X(0) < 1, X(0) — 1 or X(0) > 1. It 
is shown in Proposition 17.31 that there exists at most one solution to the CMSE for any given 
input data in Xq. When a solution exists, we let A denote the associated "centered many-server" 
mapping (associated with X) that takes (E,xq,Z) G Xq to the corresponding solution (K,X,v). 
Let dom (A) denote the domain of A, which is defined to be the collection of input data in Xq for 
which a solution to the CMSE exists. 

Remark 5.5. Suppose (K, X, v) G A(E,x ,Z) for some (E,x ,Z) G %. Then ([S~T4l and ([545]) 
together show that for t > 0, 

(5.17) X{t) =x Q + E(t) + Z{t) - [ g(t - s) [E(s) + x - v(0) - X(s) + v(s)] ds. 

Jo 

Thus, if E, Z and g are continuous then X is also continuous. If, in addition, the fluid limit is 
either subcritical, critical or supercritical then the continuity of X and (I5.16|) imply the continuity 
of v and, in turn, (I5.15[) implies the continuity of K. 

The importance of the CMSE stems from the relation 

(5.18) (A > W,AW,9W(l)) = A(^W,4 JV) ,5 ? o N) (l)-HW(l)), N g N, 

which is established in Lemma 17.21 under the assumption that the fluid limit is either subcritical, 
critical or supercritical. 
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5.3. Statements of Main Results. The first result of the paper, Theorem 15.61 below, identifies 
the limit of the sequence {X' w -*}jveN- Let 

(5.19) f» = (^^^.^.^^^(lJ.^.wW.T/WW), 

and let Yj be the corresponding quantity without the superscript N, where E,xo, Vq,S v ° ,S v °(\) 
are as defined in Remark 15.11 and Assumption [5j and M., % and H(l) are as defined in Section 
[O] Also, define 

(5.20) y x = P R [0,oo) xMxH_ 2 x2? H _ 2 [0,oo) xP,[0,oo) x 2? H _ 2 [0, oo) 2 x2? R [0,oo). 

Theorem 5.6. Suppose Assumptions [7] [21 are satisfied and suppose that the fluid limit is either 
subcritical, critical or supercritical. Then (E,Xo,S v ° (1) — H(l)) lies in the domain of the centered 
many-server map A and, as N —> oo, 

(5.21) (Y j N \ iW, jfW, (1, (Y U X, K, 9(1)) 

in y± x Dr[0, oo) 3 , where (X,K,u(l)) = A(E, Xq, S" (1) — H(l)) is almost surely continuous. 
Furthermore, if g is continuous, then 

(5.22) X(t)=X +E{t)-M t (l)-D(t), ie[0,oo), 
where 

(5.23) D(t) = v (l)-Sf°(l)-M t (l)+H t (l) + f g(t - s)K(s) ds. 

Jo 

The proof of Theorem 15.61 is presented in Section 19.11 In addition to establishing the represen- 
tation (|5.18|) , the key elements of the proof involve showing the convergence Y^' Y\ , which is 
carried out in Corollary 18. 7\ and establishing continuity of the centered many-server map A and 
another auxiliary map T, which are established in Proposition [731 and Lemma 17. 11 respectively. 

We now establish a more general convergence result for the pair {(X^ N \ ^ jv ^)}jvgn, which 
automatically yields convergence of several functionals of the process. The proof of this result is 
also given in Section l9~Tl With K equal to the limit process obtained in Theorem 15. 6[ we define 
for all bounded and absolutely continuous /, 

(5.24) %(/) = Sf°(f)+f(0)K(t)+ [ K(s)f(t-s)(l-G(t-s))ds 

Jo 

t 

K(s)g{t-s)f(t-s)ds--H t (f). 

Note that the first term on the right-hand side is well defined by the discussion following As- 
sumption [5] (see also Lemma iB.lj) . the next three terms are well defined because K is contin- 
uous and /', (1 — G), g and / are all locally integrable, and the last term is well defined since 
Ht(f) — Mt{^tf) and the continuity and boundedness of / implies ^>tf G Cb([0, L) x E+). 

Theorem 5.7. Suppose Assumptions [7JO are satisfied, the fluid limit is either subcritical, critical 
or supercritical and g is continuous. Then, as N — > oo . 

(5.25) (yW,i (w U w ,? w ) =* (Y,X,K,V) 

my = y! x 2? R [0,oo) 2 x £>h_ 2 [0,oo). 

A main focus of this paper is to show that the approximating process is a tractable process, 
thus demonstrating the usefulness of the approximation theorem obtained. The next two theorems 
show that this is indeed the case under some additional regularity conditions on the hazard rate h. 
First, in Theorem l5.8l we show that {X t , J~t,t > 0} is also a semimartingale. By Ito's formula this 
enables the description of the evolution of a large class of functionals of the process. The proof of 
Theorem 15.81 is given in Section 19.21 
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Theorem 5.8. Suppose that Assumptions^^ and\$ are satisfied, the fluid limit is either subcriti- 
cal, critical or supercritical and h is bounded and absolutely continuous. If {K, X, v) is the limit pro- 
cess of Theorem \5. 7[ then X and K are semimartingales with decompositions X = X(0)+M x +C X 
and K = M K + C , respectively, where 

M x (t)= [ o-(s)dB(s)-M t (l), C x {t) = - [ @(s)ds- [ v s {h)ds, t>0, 
Jo Jo Jo 

and if X is subcritical, then K = E and so 

M K {t) = f a(s)dB(s), C K (t) 
Jo 

if X is supercritical, then 

M K (t) = M t (l), C K {t)= f V s {h)ds, t>0, 

Jo 

and if X is critical, then 

M K (t) = jf l { ^ (s) < 0} a( S ) dB s + jf l {j?(s)>0} dM s {l), t > 0, 

and 

C K (t) = - j P(sn {x{s) < 0} ds + J^ l { x W >o}^W ds + l L §(t)> t > °' 

where, L x {t) is the local time of X at zero on the interval [0,t]. Moreover, for each t > and 
f G ACb[0,L), Vt{f) admits the alternative representation 

(5.26) V t (f)=S?°(f)+ f f{t-s){l-G{t-s))dk{s)-H t {f), 

Jo 

where the second term is the stochastic convolution integral with respect to the semimartingale K . 

Remark 5.9. If for / g Cb[0, L), {5^° (/), t > 0} is a well defined stochastic process then {vt(f), t > 
0} is also a well defined stochastic process given by the right-hand side of (|5.26|) . Moreover, under 
a slight strengthening of the conditions of Theorem 15.81 (specifically, of Assumption [5]) , we can in 
fact show convergence for a slightly larger class of functions than those in H2 . More precisely, if for 
any bounded, Holder continuous /, {S^°(f),t > 0} defined in (|5.11[) is a well defined continuous 
stochastic process and, as N -> 00, (x { N} , u^ N) (/), (/), S V ° N) (1)) =*> (x , u , S Vf > (/), S v ° (1)) in 
M 2 x2?r[0, oo) 2 , then v(f) is also a continuous process and, as N — > 00, P^ N '(f) =4> v(f) in 2?r[0, 00). 
A brief justification of this assertion is provided at the end of Section 19.21 By the independence 
assumptions of the model, the above conditions automatically imply the joint convergence 

(5.27) N \x { o N \^ Q N \f),S v o N \f),S v o N \l)) (E,x ,Mf),S V °(f),S Vo (l)) 
inP R [0,w)xM 2 x2? R [0,cx)) 2 . 

We now show that the limiting process (K,X,D) described in Theorem 15.61 can alternatively be 
characterized as the unique solution to a stochastic partial differential equation (SPDE), coupled 
with an Ito diffusion equation, and also satisfies a strong Markov property. We first introduce 
the SPDE, which we refer to as the stochastic age equation. In the definition of the stochastic 
age equation given below, h is the hazard rate function of the service distribution and vq, M. and 
K are the limit processes defined on the filtered probability space (il, T, {J 7 *}, P), as specified in 
Theorem (EH 



/ P(s)ds, t>0, 
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Definition 5.10. (Stochastic Age Equation) Given (vo,K,AA) defined on the filtered probabil- 
ity space (Q, {.Ft}, IP), v = \v t , t > 0} is said to be a strong solution to the stochastic age equation 
associated with (Pq, K, M) if and only if for every f G ACb[0, L), v t {f) is an Tt -measurable random 
variable for t > 0, s n- v s {f) is almost surely measurable on [0, oo), {vt,t > 0} admits a version 
as a continuous, W^2-valued process and V-almost surely, for every ip € C b M ([0,L) x K) such that 
Vt( - i s) + f x (', s) is Lipschitz continuous for every s, and every t £ [0, oo), 

(5.28) = "oO(-,0))+ / v s (<p x (;s) + ip s (;s)- <p(;s)h(-)) ds 

JO 

<p(x, s) M(dx, ds) + / ip(0,s)dK s . 
Jo 

[0,L)x[0,t] 

Theorem 5.11. Suppose Assumptions^ [3| and[5|' are satisfied, the fluid limit is either subcrit- 
ical, critical or supercritical and h is absolutely continuous and bounded. Given the limit process 
(K,X,i>) of Theorem \5.T\ the following assertions are true: 

(1) If the density g' of g lies in Lf oc [0,L) U L^ c [0,L) then {v t ,J-t,t > 0} is the unique strong 
solution to the stochastic age equation associated with (j)Q,K,Ai); 

(2) ifg'/(l - G) is bounded then {(X t , P t , S Vt (1)), P t , t > 0} is an E x H_ 2 x C R [0, oo) -valued 
strong Markov process. 



The characterization in terms of the stochastic age equation is established in Section 19.31 and 
the proof of the strong Markov property is given in Section [9^1 It is more natural to expect the 
process {(X,vi), Fti~t > 0} to be strong Markov with state R x H_2- However, due to technical 
reasons (see Remark 19. 71 for a more detailed explanation) it was necessary to append an additional 
component to obtain a Markov process. We expect that this additional component should not pose 
too much of a problem in applications of this result. 

Remark 5.12. Elementary calculations show that the boundedness assumptions imposed on 
g/(l — G) and g'/(l — G) in Theorem 15.111 (which, in particular, imply Assumption |4|) are sat- 
isfied by many continuous service distributions of interest (with finite mean, normalized to have 
mean one) including the families of lognormal, Weibull, logistic and phase type distributions, the 
Gamma(o, b) distribution with shape parameter a — 1 or a > 2 (and corresponding rate parameter 
b = X/ato produce a mean one distribution), the Pareto distribution with shape parameter a > 1 
(and corresponding scale parameter b = (a — l)/a so the mean equals one), the inverted Beta(a, b) 
distribution when a > 2 (and b — a + 1 so that the mean is equal to one). Note that the mean 
one exponential distribution is clearly also included as a special case of the Weibull and Gamma 
distributions. 

5.4. Corollaries of the Main Results. As an important corollary of Theorem l5.8[ when the fluid 
limit is critical, the limiting (scaled and centered) total number in system X can be characterized 
as an Ito diffusion. 

Corollary 5.13. Suppose Assumption^ As sumption \^ a) with A — 1 and Assumption [5|' are 
satisfied and h is bounded and absolutely continuous. If Xq — 1 and Vo(dx) = (1 — G{x))dx, 
the equilibrium age measure in the critical fluid limit, then X satisfies the following ltd diffusion 
equation: 

(5.29) dX(t) = x + <rB(t)-M 1 (t)-f3t- [ (h,P s ) ds, 



o 



where Mi is a Brownian motion independent of B. 
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The asymptotic independence of M.\ and B in the last corollary follows from Proposition 18.41 
In the particular case of an exponential service disribution, this allows us to immediately recover 
the form of the limiting diffusion obtained in the seminal paper of Halfin and Whitt [15] . 

Corollary 5.14. Suppose G is the exponential distribution with parameter 1. Suppose Assumption 
[l]holds withV (dx) = (1 — G(x))dx andxg = 1, Assumption^ a) holds with X = 1 and Assumption 
[5|' is satisfied. Then X is the unique strong solution to the stochastic differential equation 

ct 



(5.30) X(t) = x + \J\ + a 2 W{t) -fit- l X~ (s) ds 

Jo 

where W is a standard Brownian motion. 

Proof. When G is the exponential distribution, h = 1 and therefore 

(h,D s )ds = J (l,P s )ds = J (x(s)A0^jds, 

where the last equality uses the relations (|5 . 18[) . (j5 . 16[) and the fact that X = 1. By the indepen- 
dence of B and Ait, °~B — M\ has the same distribution as vT+ a 2 W, where W is a standard 
Brownian motion. Substituting this back into (15 -29[) . which is applicable since the hazard rate h of 
the exponential distribution is trivially bounded and absolutely continuous, we obtain (|5.30[) . The 
Lipschitz continuity of the drift coefficient x H> —j3 — x~ guarantees that the stochastic differential 
equation (|5.30j) has a unique strong solution. □ 

Remark 5.15. (Insensitivity Result) As a comparison of (|5.29[) and (|5.30j) reveals, under the 
same assumptions on the arrival process as in Corollary I5.14[ the dynamical equation for X for 
general service distributions is remarkably close to the exponential case. Indeed, the "diffusion" 
coefficient is the same in both cases (and is equal to y/l + a 2 ) , but the difference is that in the case 
of general service distributions, the drift is an {^j-adapted process that could in general depend 
on the past, and not just on X t , so that the resulting process is no longer Markovian. 

6. Representation of the System Dynamics 

In Section 16.11 we present a succinct characterization of the dynamics of the centered state 
process and then use that in Section 16.21 to derive an alternative representation for the centered 
age process. 

6.1. A Succinct Characterization of the Dynamics. We first recall the description of the 
dynamics of the A-server system that was established by Kaspi and Ramanan |22) . 

Proposition 6.1. The process (X( N \i>( N >) almost surely satisfies the following coupled set of 
equations: for ip £ C b ' ([0, L) X M+) and t G [0, oo), 

(6.1) 



(cp(;s)h(-),vl N) )ds-M { t N) (<p) 
<f(0,s)dK^(s), 



'[0,t] 

3.2) = lW(0)+£W(t)- / (h,vW)ds-M { t N \l) 



and 

(6.3) N-(l,S t N) \ = [A-XW(i)]+, 
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where satisfies 

K (N) = (i, „("))_(!, [\h, v W)ds + MW(l) 



(6.4) 

= |C)(0) + £?W - X™ + (1, i/W) - (1, i/W). 

Proof. This is essentially a direct consequence of Theorem 5.1 of Kaspi and Ramanan 22 . Indeed, 
by subtracting and adding on the right-hand side of equations (5.4) and (5.5) in [22 , and 

then using (|4.3|) above and the fact that is indistinguishable from M^ N \ip) (see Remark 

I4.3|) one obtains (|6.1I) and (|6.2[) . respectively. Equation (I6.3[) coincides with equation (5.6) in [2"2"] . 
Finally, the first equality in (|6.4p follows from (2.6) of [22] and (|4.3I) above, whereas the second 
equality in (|6.4p follows from (|6.2[) . □ 



Combining the characterizations of the A^-server system and the fluid limit given in Proposition 
I6.1l and Theorem l3.21 respectively, we obtain the following representation for the centered diffusion- 
scaled state dynamics. In what follows, recall the centered, diffusion-scaled quantities defined in 
(ISTTD and BUj) . 

Proposition 6.2. For each N € N, the process {X^ N \V^ N ^) almost surely satisfies the following 
coupled set of equations: for every <p € C*' ([0, L) x M + ) and t £ [0, oo), 

(6.5) (*>(•, = (^(-,0),^ iV) )+/ t (^ ( '' s)+ ^ ( -' s) '^ JV) ) ds 

^(0,s)dif (JV) (s), 

[o,t] 

(6.6) jW(t) = iC)(0) + £C)(t)- f\h,^)ds-Mi N \l), 

Jo 

and 

( l(*)(()A\/iV(l-Ii ifX{t)<\, 

(6.7) (l^ t (JV) > = <^ ^»(*)A0 i/^(t) = l, 

[ \/JV(I (W) (f)-l)A0 ifX(t)>l, 

where 

(68) £ (JV) = (^^^-(ui+^Mfv^^a) 

= ^ ) +£( N )-l( w '+°(l,^))-(l,?( f "). 

Proof. Equation (16.51) is obtained by dividing each side of the equation (|6.1[) by N, subtracting the 
corresponding side of Q3.6P from it and multiplying the resulting quantities by ^/N. In an exactly 
analogous fashion, equation (|6.6|) can be derived from equations (|6.2j) and (|3.7|) , and equation (|6.8|) 
can be obtained from equations (|6.4[) , fl3.7[) and p. 91) . It only remains to justify the relation in 
(|6.7[) . Dividing (|6.3[) by AT, subtracting it from (13.81) and multiplying this difference by y/~N, we 
obtain 

(6.9) (1, d[ N) ) = Vn([i- X(t)}+ - [I - x (N) (<)]+) . 

If ^(t) < I then [1 — X(t)] + = (1 — X(t)) and so the right-hand side above equals 

N(l-X(t) - (1 -X (N) (t)) =X( N \t) if X [N) (t) < 1, 

iV(l-X(i)) if X (Ar) (t) > 1, 
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which can be expressed as lW(t) A y/N(l - X(t)). On the other hand, if X(t) = 1 then [1 - 
A(i)] + = and the right-hand side of (|6.9[) equals 

-y/N[l -X (N \t)}+ = -VN[X(t) -X {N \t)}+ = jfW(t) A 0. 

Lastly, if X(t) > 1 then [l-X(t)}+ = and so the right-hand side of (jUJ) reduces to VN{X {N \t)- 
1) A 0, and (57F|) follows. □ 

Remark 6.3. We describe conditions under which, for large N, the non-idling condition (|6.7p 
can be further simplified and written purely in terms of (1,9^) and X^ N \ Let fl* be the set of 
full P-measure on which the fluid limit theorem (Theorem l3.2p holds. Fix lu £ ft* (and henceforth 
suppress the dependence on w) and let t £ [0, oo) be a continuity point of the fluid limit. If X{t) < 1 

then by Theorem I3~21 there exists N = N (uj, t) < oo such that for all N > N , X (N \t) < 1 and 
so 

xW(t) = Vn (x {N \t) - x(tj] < Vn(i - x(t)). 

On the other hand, if X(t) > 1 then there exists No = No(uj,t) < oo such that for all N > Nq, 
X (t) > 1 and hence, 

VN(X (N \t)-l)>0. 
Therefore, for any t £ [0, oo) there exists A*o = Nq(oj, t) < oo such that for all N > Nq, 

( xW( t ) if X(t) < 1, 

(6.10) (l,d ( t N) ) = \ XW(t)A0 ifX(t) = l, 

[ if X[t) > 1. 

Now, suppose the fluid limit X is continuous and for some T < oo, the fluid is subcritical on [0, T] 
in the sense of Definition 13.31 Then iVo can clearly be chosen uniformly in t £ [0,T] and so there 
exists iV = N (uj,T) < oo such that for all N > N (uj,T), 

t£[0,T}. 

An analogous statement holds for the supercritical case and (trivially) for the critical case. 

6.2. A Useful Representation. Equations (|6.1|) and ([6. 5ft for the age and (scaled) centered age 
processes, respectively, in the iV-server system have a form that is analogous to the deterministic 
integral equation (13.61) that describes the dynamics of the age process in the fluid limit, except 
that they contain an additional stochastic integral term. Indeed, all three equations fall under the 
framework of the so-called abstract age equation introduced in Definition 4.9 of Kaspi and Ramanan 
|22) . Representations for solutions to the abstract age equation were obtained in Proposition 4.16 
of [22]. In Corollary 16.41 below, this result is applied to obtain explicit representations for the age 
and centered age processes in the TV-server system. Not surprisingly, these representations are 
similar to the corresponding representation (|3.10p for solutions to the fluid age equation, except 
that they contain an additional stochastic integral term. 

We now state the representation result, which is easily deduced from Proposition 4.16 of Kaspi 
and Ramanan [22]; the details of the proof are deferred to Appendix [Cl For conciseness of notation, 
for N £ N and continuous /, we define 

(6.11) iC { t N \f)= f (l-G(t-s))f(t-s)dK^( S ), i€[0,oo). 

J[0,t] 

By applying integration by parts to the right-hand side of (|6.11|) and using the fact that K^ N > has 
jumps at at most a countable number of points, we see that for absolutely continuous /, 

(6.12) Kf>{f) = f(0)K (N) (t) + f £ (A °(sK/(* - s) ds, 

Jo 
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where 

(6-13) = (/(l - G))' = f'(l - G) - fg. 

Also, recall the definition of the process S v o given in (|5.10[) . 
Proposition 6.4. For every N £ N, f £ Cb[0,L) and t £ [0, oo), 

(6.14) (j> t (JV) ) = sf\f)-H { t N) (f)+lC { t N \f), 
and, likewise, 

(6.15) (fM N) ) = sf\f)-H { t N) (f)+Z { t N \f). 

Remark 6.5. For subsequent use, we make the simple observation that on substituting ip = 1 in 
(|6.5j) and substracting it from (|6.15|) , with / = 1, then rearranging terms and using (|6.12[) and the 
fact that £l = (1 - G)' = -g by (f6TT3]l . we obtain for every N £ N and t > 0, 

(6.16) Jo t 

■/o 

7. Continuity Properties 

In Section [7TT1 we establish continuity of the mapping that takes to KS N > and in Section 

I7.2l we establish continuity of the centered many-server map A, which in particular shows that both 
K<- N l and AW are obtained as continuous mappings of the initial data and US K 

7.1. Continuity of an Auxiliary Map. Here, we establish the continuity of a mapping related 
to the convolution integral K^ N > defined in (|6 . 1 1 [) . Given any (deterministic) cadlag function K, 
for absolutely continuous functions / we define 

(7.1) Kt{f) = /(O)A(t) + f K(u)£ f (t - u) du, 

Jo 

where £f — (/(l — G))', as defined in ()6.13|) . Since K, g and /' are all locally integrable, for 
each t > 0, ICt is a well defined linear functional on the space of absolutely continuous functions. 
Moreover, from elementary properties of convolutions, it is clear that for any absolutely continuous 
/, if K is cadlag (respectively, continuous) then so is JC(f). In Lemma [7TT1 below, we show that K, 
is in fact a cadlag H_2-valued function and the mapping from K to /C, which we denote by T, is 
continuous. Note that by (l6"42")) K. (N) = T(K^) for N £ N. The continuity of T is used in the 
proof of Theorem 15.71 to establish convergence of KS N ^ to the analogous limit quantity 1C, defined 
for absolutely continuous /, by 

(7.2) K t (f) = f(0)K(t)+ [ K(s)£ f (t-s)ds, te[0,oo). 

Jo 

The third property in Lemma 17.11 below is used in the proof of the strong Markov property in 
Section WM 

Lemma 7.1. Suppose T is the map that takes K to the linear functional K, defined in J 7. i| ). If g 

is continuous the following three properties are satisfied: 

(1) If K £ 2?r[0, oo) (respectively, Cr[0, oo),) then fC G Du_ 3 [0, oo) (respectively, Ch_ 2 [0, oo)). 

(2) r is a continuous map from 2?r[0, oo) to T>]gi_ 2 [0 y oo), when both domain and range are 
either both equipped with the topology of uniform convergence on compact sets or both 
equipped with the Skorokhod topology. Likewise, the map from 2?r[0, oo) to itself that takes 
K i— > JC(1) is also continuous with respect to the Skorokhod topology on 2?r[0,oo). 
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(3) If K G Cr[0, oo) then, for any t G [0, oo), the real- valued function u i— > /Ct(<I> u l) on [0, oo) is 
continuous and the map from Cr[0, oo) to itself that takes K to this function is continuous 
(with respect to the uniform topology). 

Proof. Let g be continuous. We first derive a general inequality (see (|7.7|) below) that is then used 
to prove both properties 1 and 2. Fix K,K {n) G X> R [0,oo), T < oo and t,r (n) (i) G [0,T] with 
£<»(*) = |i-T<»(i)|, neN. Also, let JC = T(K) and = T{K&>), neff. For / G H 2 , we can 
write 

(7-3) /cg )(t) (/)-/C t (/) = /(0) (tfW(rW(t)) - !T(t)) + £A<" ) (i), 

where 



i=l 



/■tAT ( " } (i) 

A< n) (t) = / K( U )(^(i-n)-^(r„(t)- W ))d U , 



A { 2 n \t) = J {K{u)-K^{u))^{T^{t)-u)du, 

ft /■T fn) (i) 
A£°(t) = / -u)du + / K {n \u)^f{T {n) {t)-u)du. 

To bound the above terms, first note that by the inequality (1 — G) < 1, repeated application of 
the Cauchy-Schwarz inequality and Tonelli's theorem we obtain 

\f(t - u)(l - G(f - u)) - /'(a - u)(l - G(s - u))| cfc 

</ \f'(t-u)\(G(t-u)-G(s-u))du+[ \f\t-u)-f\s-u)\du 

t 

< w G (\t - s|)T 1/2 ||/'|| Hq + J' (J \f"(w - u)\ dw\ du 

<w G (\t-s\)T^\\fi\\ mo +T\t- S S \^\\f"\\ Bo , 

where wg is the modulus of continuity of G as defined in Similarly, using the continuity of 

g and, as usual, denoting its modulus of continuity by w g , we have 

\f(t - u)g(t -u)- f(s - u)g(s - u)\ du 

< f \f{t~u)\\g{t-u)-g{s-u))\du+ f g(s - u)\f(t - u) - f(s - u)\du 



<T 1/2 \\f\\ no w g {\t~s\)+ J g(s~u) J \f'(w-u)\dwdu 

< T 1/2 ||/|| Ho w g (\t s\) + \t- s\^ ||/'|U o < (T^w g (\t - S |) + \t - s\V 2 ) ||/|| Hi . 
Recalling that £/ = (/(l — G))', the last two inequalities show that 

(7-4) f |£/(t - «) - i f {s -u)\du< Cl (T, \t - s\) ||/|| Ha , 

Jo 

where a(T,6) = (T 1 / 2 (w G (5) + iu 9 (5)) + (T + l)^/ 2 ) satisfies lim^o ci(T, <5) = 0. On the other 
hand, another application of the Cauchy-Schwarz inequality and the norm inequality ()1.2|) shows 
that 

rt \t f (t-u)\du < /VM|rf«+ll/IL(G(*)-G(*)) 



(7 - 5) * < it s - «r /2 ii/'Hmo + ii/iioo - 

< 3(\t- S \^+w G (\t- S \))\\f\\ Bi <c 2 (T)\\f\\ mi , 
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and 
(7.6) 



lie/ll T <ll/ / ll 00 + ll/IUNI r <c 2 (T) n/ii 



for an appropriate finite constant c 2 (T) < oo that depends only on G and T. Substituting (|7.4I) - 
into (I7.3|) . we obtain 



(7.7) 



< 



K(t)- K^(T (n Ht)) 



Cl 



+c 2 (T) 



+2jW(i)c 2 (T) (| 



K\\ T V 



du 



Now, suppose = K so that /C^ = /C, n £ N, and consider t < T and any sequence of points 
(t) € [0, T], n € N, such that (t) | i as n -> oo. Then the third term on the right-hand side 
of (|7.7I) vanishes, the first term converges to zero because K £ I?m[0, oo) and the second and fourth 



and 



terms converge because ||if|| T < oo and S^ n '(t) — > 0. This shows that ||/C 

hence, K, £ 2?h_ 2 [0, oo). The same argument also shows that /C is continuous if K is. This proves 
the first property. 

Next, suppose that K^ n \ n £ N, is a sequence that converges to K in the Skorokhod topology. 
By the definition of the Skorokhod topology (see, for example, Chapter 3 of [4]) there exists a 
sequence of strictly increasing maps r^ n \ n £ N, that map [0,T] onto [0,T] and satisfy ||#(™)|| T = 
sup te[0 T ] \t - r (n) (t)| and ||i<r (Ti:i o t (ti) - *|| T as n -> oo. Moreover, sup n ||if (n) || T < oo 

and K^(u) — > if(u) for a.e. u £ [0,T]. Taking first the supremum over £ 6 [0, T] and then 
limits as n — > oo in (|7.7[) . the above properties show that the right-hand side goes to zero (where 
the dominated convergence theorem is used to argue that the third term vanishes). In turn, this 



implies that sup tg [ t] 



/Cf — K 



(n) 



)(t) 



0, thus establishing convergence of £W to K in the 



Skorokhod topology on T>m_ 2 [0,oo). This establishes continuity of the map T in the Skorokhod 
topology. Continuity with respect to the uniform topology can be proved by setting (t) = t, 
n £ N, in the argument above. The continuity of the map that takes K to /C(l) can be established 
in an analogous fashion. The proof is left to the reader. 

To prove the last property, fix K £ Cr[0,oo) and t £ [0,oo). For u > 0, the function $ u l is 
absolutely continuous and £$ u i = (1 — G(- + u))' = —g(- + u). Setting / = <£>„! in (|7.1[) yields 



/C t ($ M l) = (1 - G(u))K(t) - [ K(s)g(t -s + u) 

Jo 



ds . 



The continuity of G and K and the bounded convergence theorem then show that u H > /Ct($ u l) 
lies in Cr[0, oo). On the other hand, given K^' £ Cr[0, oo) for i = 1,2 and the corresponding KS % > , 



-(2)/ 



ie[o,T] 



< 

















m) cis 



from which it is clear that the map from Cr[0, oo) to itself that takes K to the function u /C t ($ n l) 
is continuous. □ 



7.2. Continuity of the Centered Many-Server Map. Recall the centered many-server map A 
introduced in Definition First, in Lemma l7.21 we establish the representation for (IW , K^ N > ,P^ N ^ 
in terms of the map A specified in (|5.18p . and then in Proposition [731 and Lemma [7^1 we establish 
certain continuity and measurability properties of the map A. 
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Lemma 7.2. If the fluid limit X of the total number in system is either subcritical, critical or 
supercritical and Assumption [^] holds, there exists fl* G J- with P(f2*) = 1 such that for every 
ui G il*, there exists N*(lo) < oo such that for all N > N*(to), 

(P, X^\ (1, - A((IW , 5^°, 5 p o N> (i) - «W(1))( U ). 

Proof. Fix TV G N. By the basic definition of the model, 12 W is cadlag and takes values in 
^-V^ICL)^ 00 ) an d hence, in 2?e_ 2 [0j°°)- Due to Assumption @] and Remark [Ol it follows that 
S"° (1) is continuous. Moreover, as explained in the discussion right after definition (|7.ip . /C(l) 
is also continuous. By the representation (16. 15[) . it then follows that 71^(1) is also cadlag. Thus, 

for almost surely every lo G O, (E~( N \x ( N) , S P ° N) (1) - H^(1))(uj) G 2o- The result then follows 
on comparing the three many-server equations (|5.14l) . (|5.15l) and (|5 . 16[) with the second equation 
in (|6.8p , equation (|6.10l) of Remark 16.31 and equation (16.15[) . □ 

We now establish continuity and measurability properties of the mapping A. Recall that U 
denotes the renewal function associated with the distribution G. 

Proposition 7.3. Fix A G X> R+ [0,oo). Fori = 1,2, suppose (E\x ,Z l ) G % and (K\X\v l ) G 
A(E i ,x i Q , Z' 1 ). Then, for any T G [0,oo), 

(7.8) I|V1^|| T V ||VA|| T V || W|| T < 3(1 + U(T))e T , 
where VS = S 2 — S , \\f\\ T = sup sg [ 0T ] |/(s)| and 

(7.9) e T = (||V£|| T V |Va;o| V ||VZ|| T ) . 

Hence, A is continuous with respect to the uniform topology and is single-valued on its domain. 

Proof. Fix T < oo. We first show that ||V1T|| T < 2e T (l + U{T)). For any t G [0,T], we consider 
two cases. 

Case 1: Either X(t) < 1, or both X{t) = 1 and A x (t) < 0. 
We claim that in this case we always have 

(7.10) Vv(t) - VX(t) < 0. 

Indeed, (|5.16|) shows that if X(t) < 1 then v l (t) = X l (t) for i = 1,2 and so the left-hand side 
above is identically zero. On the other hand, if X(t) — 1 and X x {t) < then (A 1 (t))+ = 0, and 
so (|5.16[) . combined with the elementary identity iA0-i = — x + , implies 

V«(t) - VX(t) = (A 1 (i))+ - (X 2 (t)) + = -{X 2 (t)) + < 0, 

and so fTTOf holds. 

In turn, combining (|7.10[) with the fact that each solution satisfies equation (|5. 15|) . we then 
conclude that 

(7.11) VK(t) = Vx + VE(t) - VA(<) + Vv(t) < Vi + VE(t) < 2e T - 

Case 2: Either X(t) > 1, or both X(t) = 1 and X 1 {t)> 0. 
First, we claim that in this case, 

(7.12) Vv(t) = v 2 {t) - v 1 ^) < 0. 

If either X(t) > 1, or the relations X(t) = 1, A 1 ^) > and X 2 (t) > hold, this is trivially true 
since by (|5.16j) each term on the left-hand side of ()7.12|) is equal to zero. In the remaining case 
when X(t) = 1, A*(t) > and X 2 (t) < 0, (flUo) shows that v 1 ^) = and v 2 (t) = X 2 (t) < 0, and 
once again (|7.12p follows. 

Next, considering that each solution satisfies the equation (|5.14[) and taking the difference, we 
have for every t G [0, oo), 

(7.13) VK(t) = Vv(t)+ [ g(t- s)V K{s) ds -V Z{t). 

Jo 
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Now, define 



B=\t: g(t - s)VK(s) ds > j . 
Then, combining (j7.13[) with (|7.12l) . we conclude that 

VK(t) < 2e T + ls(*) / g(t - s)VK(s) ds. 
Jo 



Applying the same inequality to K(s) for s G [0, t] and substituting it into the last inequality, we 
then obtain 

g(s — r)\7K (r) dr I ds 



VK(t) < £ T + i B (t) J g(t - s) Ust + a B (s) J 



< e T (l + G(t)) + t B (t) J g(t - s) lls(s) J g(s-r)\/K{r)drj ds. 
Reiterating this procedure, we obtain 

(7.14) VK(t) < e r (l + G(t) + G*' 2 {t) + ...)< e T U(T), 

where G* ,n denotes the n-fold convolution of G. 

By symmetry, the inequalities (|7.11[) and (I7.14p obtained in Cases 1 and 2, respectively, also 
hold with VK replaced by —WK. Since U(T) > 1, we then have 

\VK(t)\ < 2e T U(T), for every t G [0,T]. 

Taking the supremum over t £ [0,T], we obtain 

(7.15) ||Vif|| T < 2e T U(T). 

Now, relations f|5 . 14[) and (|5.15j) . together, show that for i = 1, 2 and t G [0, T], 

X 4 (i) = ^ 4 (t) + 4 - - / 9(t~ s)K l (s) ds + Z\t). 

Jo 

Taking the difference and using the fact that (|5.16j) implies |V(xq — w l (0))| < |Vxo|, we obtain 

|VX(t)| < ||VS|| T + |Vx | + / g(t- s)\\VK\\ T ds + \\V Z\\ T . 

Jo 

Taking the supremum over t £ [0, T] and using (|7.15[) , we then conclude that 

||VX|| T < 3e T + 2e T U{T)G{T) < 3e T (l + U(T)). 

Together with (|7TT5|) and the fact that (jSTTbl) implies ||Vu(*)|| T < ||VX|| T , this establishes ([715]) . 
Since the Skorokhod topology coincides with the uniform topology on the space of continuous 
functions, (|7.8p implies that the map A is continuous at points (E,x Q ,Z) G Cr + xlx Cr + . □ 

Lemma 7.4. Suppose the fluid limit is subcritical, critical or supercritical. Then the map A from 
dom (A) C Dr[0, oo) x R x 2?r[0,oo) to 2?r[0,oo) 3 , with Pr[0, oo) equipped with the Skorokhod 
topology, is measurable. 

Proof. We first observe that it suffices to establish the measurability of the map from (E, xq,Z) G 
dom(A) to X, where (K,X,v) = A(E,xq, Z). Indeed, in this case, because the maps / h-> /, 
/ 4 / AO and / H> from 2?r[0, oo), equipped with the Skorokhod topology, to itself are all 
measurable (in fact, continuous) and addition is also a measurable mapping from £> R [0,oo) 2 to 
2?r[0,oo), it follows from (|5.15[) and (|5.16[) that the map to (K,v), and therefore the map A, is 
also measurable. 

By Remark 15.51 if (K, X, v) — A(E, Xo, Z) then X satisfies the integral equation 
X(t)=R(t)+ [ g(t- s)F(X(s))ds, t>0, 
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where R(t) = Ri(t) = Z(t) + E(t)- f* g(t- s)E(s) ds and F = if X is subcritical, R(t) = R 2 (t) = 
Ri(t) + (1 — G(t))xo and F{x) = x if X is supercritical, and R(t) = Rv{t) and F(x) — x + if X is 
critical. Note that in all cases, F is Lipschitz. Also, for fixed t, the map (E,Z,xq) H> R(t) from 
2?r[0, oo) 2 x 1 i-> R is clearly measurable. The latter fact implies the proof for the subcritical case. 
For the other two cases, by standard arguments from the theory of Volterra integral equations (see 
Theorem 3.2.1 of [5]) it follows that X(t) = lim„_ > . oo (T n )0)(t), where 7j is the n-fold composition 
of the operator T : £> R [0,co) >->• £> R [0,oo) given by (TOW = #aW + Jo f(* - s)F(£(s))ds, 
£ G 2?r[0, oo). Due to the fact that convergence in the Skorokhod topology implies convergence in 
i-q oc , the map £ i— > F(£) is a continuous mapping from Lj" oc to itself and the Laplace convolution 
i y Jq g(- — s)9(s) ds is a continuous map from L ioc to C[0, oo), it follows that for every t > 0, 
(-R, >— > T(0(*) i g a measurable map. Because the Borel algebra associated with the Skorokhod 
topology is generated by cylinder sets, and measurability is preserved under compositions and 
limits, this implies that the map from R to X is measurable. Note that in the critical case, the 
above equation is of the same form as the one obtained in Theorem 3.1 of Reed [30., and a more 
detailed proof of measurability in the critical case can also be found in the Appendix of 30 . □ 



8. Convergence Results 



The representation f|6. 15[) of the pre-limit dynamics and the continuity properties established 
in Section [7] reduce the problem of convergence of the sequence {^^}jveN to that of the joint 
convergence of the sequence of stochastic convolution integrals {'H^ N '}NeN an d the sequences 
representing the initial data. In this section, we establish these convergence results. First, in 
Section [8T2l (see Proposition 18. 4p we establish the joint convergence of the sequence {-M^jiveN 
and the sequence of centered arrival processes and initial conditions showing, in particular, that 
the centered departure process is asymptotically independent of the centered arrival process and 
initial conditions. Then, in Section 18.31 (see Corollary 18. 7\i we identify (for a suitable family of 
/) the limits of the sequence {H^> (/)} nen- Both limit theorems are proved using some basic 
estimates, which are first obtained in Section [8.11 



8.1. Preliminary Estimates. Let U denote the renewal function associated with the service 
distribution G. We begin with a useful bound, whose proof is relegated to Appendix ID] 



Lemma 8.1. Fix T < oo. For every N £ N and positive integer k, 



E 



a[ n \t) 



E 




J[0,L) 



h{x)v[ N \dx) ds 



< k\{U{T)f 



Moreover, there exists C (T) < oo such that for every positive integer k and measurable function ip 
on [0,L) x [0,T], 

/ \ k 



sup E 



<k\(C(T)) / ip*(x)h(x)dx 

\J[0,L) , 



where ip* (x) = sup se [ m \ip(x, s)\ . Furthermore, if Assumptions^ and& hold, then 



(8.2) 



(Ai(T)Y 




J[Q,L) 



h{x)V s (dx)ds\ <k\{U{T)) k . 



We now establish some estimates on the martingale measure Ai^ N \ which are used in Sections 
and 18.31 to establish various convergence and sample path regularity results. 
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Lemma 8.2. For every even integer r, there exists a universal constant C' r < oo such that for 
every bounded and continuous function ip on [0, L)xl and T < oo, 



(8.3) 



(8.4) 



E 



sup 

s€[0,T] 



E 



sup 

»e[o,T] 



<C r \\<p\ 



(U(T)) 



r/2 



1 



N r / 2 



N e N, 



< C r 



(U(T)) 



r/2 



and, for < s < t, 
(8.5) 



\M t (<p) - M s (<p)\ r < C r (V (t) - A^(s)) 



r/2 



Proof. Since .M^-* (9?) is a martingale, by the Burkholder-Davis-Gundy (BDG) inequality (see, 
for example, Theorem 7.11 of Walsh [35]) it follows that for any r > 1, there exists a universal 
constant C r < 00 (independent of (p and .M^) such that 

r/2' 



(8.6) 
where 



sup 



AM 



(*>) = 



< CLE 



(<*tWfo)> 5 



(JV) 



sup 

te[o,T] 



sup 

t£[0,T] 



■ C,.E 



AM 



\<P) 



Because the jumps of MS N \<p) are bounded by 



m 



(8.7) 



AM { T Nh *(<p) 



I v N, we have 

IMIL 



< 



Nr/2 



On the other hand, by (|4.12[) it follows that for any r > 0, 



(jwW(,)}f]= E [(^(T) 



< 



E 



3f 3 (T) 



r/2' 



When combined with (|8.ip of Lemma l8~Tl this shows that if r = 2k, where k is an integer, then 



E 



Combining the estimates (|8.6j) - (|8.8j) obtained above, we obtain (|8.3[) . 

In an exactly analogous fashion, replacing M^ and A , respectively, by M and A, and using 
the continuity of M(<p) and inequality (|8.2p of Lemma |8"7T1 we obtain (I8.4[) . Furthermore, for fixed 
s > 0, because {A4 <(</?) — M s (<p)}t>s is a continuous martingale with quadratic variation process 
{A v 2 (t) — A v 2 (s)} t> s , another application of the Burkholder-Davis-Gundy (BDG) inequality yields 

23. ' □ 



As a corollary, we obtain results on the regularity of the processes M^ and M, which make 
use of the norm inequalities in (|1.2p . 

Corollary 8.3. Each M {N} ,N G N, is a cadldg M-2-valued (and hence S' -valued) process. M is 
a continuous M-2-valued (and hence S' -valued) process. Moreover, for any T < 00, if for every 
f € S, M [N) {f) =► M(f) in V R [0,T] as N -> 00 i/iera A1 (JV) M in X> H _ 2 [0,T] as N -> 00. 

Proof. Fix A € N. By Remark l4.31 for every f £ S there exists a cadlag version M} w) ofAfW(/). 
Moreover, for any T < 00 it follows from (|8.3[) and (|1.2I) that given any e > and A < 00 there 
exists S > such that if < 5 then 



(8.9) 



lim sup 1 

JV 



sup \M[ N \f)\>\) <e. 
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Thus, each MS N ^ is a 1-continuous stochastic process in the sense of Mitoma [27]. Since S is 

a nuclear Frechet space and ||-|| H < ||-|| H . 3 (refer to the properties stated in Section fl.4.1|) . by 

Theorem 4.1 of Walsh [35] and Corollary 2 of Mitoma [27] it follows that A? (Ar) is a cadlag H_ 2 - 
valued, and hence <S'-valued, process. 

On the other hand, by Lemma 15721 A4( f ) is a continuous process for every / € S. An analogous 
argument to the one above, that now invokes Corollary 1 of Mitoma [27] and (|8.4[) . shows that 
M. is a continuous H_2-valued process. The last assertion of the corollary follows from (|8.9p and 
Corollary 6 . 1 6 of Walsh [35] . □ 

8.2. Asymptotic Independence. We now identify the limit of the sequence of martingale mea- 
sures {.M^jiveN an d also show that it is asymptotically independent of the centered arrival 
process and initial conditions. We recall from Assumption [5] and Remark 15. II that A4 is indepen- 
dent of the initial conditions (xq, Vq, S"° , S v ° (1)) and E, where E is a diffusion with drift coefficient 
— /3 and diffusion coefficient a 2 . 

Proposition 8.4. Suppose Assumptions\^^and Assumption\^hold. Then for every if £ Ch([0,L)x 
R), M {N) (ip) M((p) in Dr[0, oo) as N -> oo. Moreover, as N ->• oo ; 

(m\4 N \^ N \s^ N \s^\ 1) ,M^) =► (E,x ,P ,S*,S*(l),M) 
mV R [0,oo) x R x H_ 2 x 2? H _ 2 [0,oo) x 2? R [0,oo) x 2? H _ 2 [0,oo). 

Proof. We shall first prove the assertion under the supposition that Assumption [3fa) is satisfied, 
in which case A, tr 2 are positive constants and (3 is a constant in R. We start by using results of 
Puhalskii and Reiman [28] to recast the problem in a more convenient form. Fix N £ N and define 



£ (JV) (t)+l 



J'=2 

where recall that {^j }jeN is t ne i-i-d. sequence of interarrival times of the Nth renewal arrival 
process E (N \ which has mean l/A^' and variance (a 2 /X)/(X^ N ^) 2 . Define 

UN) (E^Ht) + l \ 



Using the definition (|5.2I) of /3 and the fact that (<) = Xt, we see that 

(no) fiw (() . ^"'"'-^ . ^i^ZW^ + „ _ £<»» (t) + ,(«) (f) + * 

VAT y/N 



Puhalskii and Reiman (see page 30, Lemma A.l and (5.15) of [2S]) showed that {£W(t), ^ N \t > 
0} is a locally square integrable martingale and, as N — > oo, sup t<T |7^(t)| — > in probability, 
which implies 7^ => 0. 

We will now show that for every bounded and continuous /, 

(8.11) {L {N \M { f N) )^{B,M{f)) as N 00, 

and for real- valued bounded, continuous functions £1 on R 2 and £2 on R x H_2 x Z?h_ 2 [0, 00) x 
Z>r[0,oo), 

lim Efe^I^^^^W)] 

(8.12) 2V->oo J 

= E[£ 1 (X / , J B)]E[£2(^,^o,5 % , l S Po (l))]. 
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Before presenting the proofs of these results, first note that on combining (|8.11[) with (|8.10p . 
the fact that => as A — > 00 , the relation E(t) — B(t) — j3t, t > 0, and the continu- 

ous mapping theorem, it follows that for every bounded and continuous /, (E^ N ',M.^ N '(f)) => 
(E,M(f)) in 2?r[0,oo) 2 . Together with (|8.12[) this implies that for every bounded and contin- 
uous /, (EW,^.^.^.^ (l),M {N \f)) => (E,x ^o,S 9o ,S Po {l),M(f)) as A 00. 
Together with Corollary 18.31 this implies the desired convergence stated in the proposition. 

Thus, to complete the proof (when Assumption [3]^ a) holds), it suffices to establish (|8.11l) and 
(|8. 12|) . This is done in the following four claims; the first three claims below verify conditions of 
the martingale central limit theorem to establish (|8. 1 1|) . whereas the last claim proves (|8.12|) . 



Claim 1. For t > 0, as A 



L (N) 



a 2 t and 



M 



(TV) 

f 



A p (t) in probability. 



Proof of Claim 1. Note that L^ N \ being a compensated sum of jumps, is a local martingale of 
finite variation. Thus, it is a purely discontinuous martingale (see Lemma 4.14(b) of Chapter I of 
Jacod and Shiryaev [T7]) and hence (by Theorem 4.5.2 of Chapter 1 of [T7]), its {T^} optional 
quadratic variation is given by 



'(t)+i 



£ E d-A^f } ) 2 



N 



For every j e N, E[(l - AW^) 2 
At by Remark l5.ll and Theorem 



arrays of random variables, 



= a 2 /\ < 00 by Assumption [3Ja), and almost surely E^ N \t) — > 
Therefore, by the strong law of large numbers for triangular 
converges to 



lim 



#)({)-! 



A 



E 



(l - 



= a 2 t 



as A 



00. This establishes the first limit of Claim 1. 
Now, M j: N ^ is also a compensated sum of jumps. By the same logic we then have 



AI 



(TV) 



where the last equality follows because the jumps of Mi N ^ coincide with those of Q K f ' ■ The results 
of Kaspi and Ramanan (see Theorem 5.4, the discussion below Theorem 5.15 and Proposition 5.17 

of [35]) show that Qp (t) — > Ap(t) in probability, and so the second limit in Claim 1 is also 
established. 

Claim 2. For every t > 0, 



Proof of Claim 2. Let r, 
unit jumps, it follows that 



(JV) 



— > in probability as A — > 00. 



ELi Q be the time of the ith J um P of E(N) - Since EiN) has 



5.13) 



A 



E f 1 - A(JV) e 



(TV) 
i+1 



AM 



(/V) 



(,-<»>). 



i>2:r y 



><t 



To prove the claim, it suffices to show that 



5.14) 



E 



< 



1/11 



AA 



-E 



E 



(.f>) 



'<t 



Indeed, then the right-hand side goes to zero as A — > 00 because the expectation on the right- 
hand side is bounded by sup^EfD N (t)], which is finite by Lemma 5.6 of [32] (alternatively, the 
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convergence to zero can also be deduced from the stronger result stated in Corollary IA.2|) 

claim then follows by an application of Chebysev's inequality. 

(JV) 



The 



To establish (|8.14l) . we hrst introduce the filtration {F( ,t > 0}, which is defined exactly like 



the filtration {F^ N \t > 0}, except that the forward recurrence time process R { g ' associated with 
the renewal arrival process E^ N ^ is replaced by the age or backward recurrence time process a 



(JV) 



(JV) 



which satisfies a ( ^ ] (s) = s - sup{w < s : < D W ( S )} v for s > °- :t 

is easy to verify 



that is an { F^" ' }-adapted process and, for each i £ N, t^" 1 is an { F\ JV ' }-stopping time 

Moreover, for every i G N, using the independence of Ci+x from F we have 



r(JV) 



(JV) 



.15) 
.16) 



[1-AW^I^] = E[1-AW^] 



2 _ 



(JV) 



e[(i-aW#2) ! 



= o, 



a 2 /A. 



For i e N, conditioning on F^X, noting that the jump times of Ali N ^ and D^ coincide, and 



using ((8T6| and the estimate (AM^ N) ) 2 < 



E 



/|| ^ AD N , we obtain 



2 x 



< 



(rry 



i/ii 



-AD 



W / (JV) 



A similar conditioning argument using (18. 15)) shows that for 2</«<i,i,/cGN, 



E 



(l - AW£ffi) AMf > (rf >) (l - A(-)e^) AM^ (r^) 



= 0. 



Taking first the square and then the expectation of each side of (|8.13[) and using the last two 

relations, we obtain (|8.14[) . As argued above, this proves the claim. 

Claim 3. The jumps of (Z( N \ M (N) (f)) are asymptotically negligible and (gUP holds. 

Proof of Claim 3. The jumps of DW and converge to zero as N — > oo because is 

a counting process with unit jumps and sup t<T |7^(t)| ^ in probability. Also, by Lemma 14.11 

and the continuity of Aj, the jumps of M {N) {f) = M [ f N) are uniformly bounded by H/H^ /VN, 

and so they also converge to zero in probability. Because {(L^ N \ M^ N ^ (/))}jvgn is a sequence of 
martingales starting at zero, we can apply the martingale central limit theorem (see, e.g., Theorem 
1.4 on page 339 of Ethier and Kurtz QZ3)- The conditions of that theorem are verified by claims 
1-3 above, and (|8.11j) follows from the observation that B and M(f) are independent, centered 
mean Gaussian processes with variance processes a 2 t and Af2(t), t> 0, respectively. 
Claim 4. The asymptotic independence property in (|8.12j) holds. 

Proof of Claim 4. Conditioned on F^ N \ LW and M { f N) are still compensated sums of jumps 
with the same optional quadratic variation processes as without conditioning. Thus, the same 
argument provided above in claims 1-3 above show that, conditioned on Fq , the sequence 
(LW.Mf) still converges weakly to (B,A4(f)). In particular, by the continuous mapping the- 
orem, this then implies that for any bounded continuous function F± on M 2 , 



lim E 

JV-yoo 



FxiL^^M^mFr =E[F 1 (B(t),M t (f))} 



This establishes the desired asymptotic independence because for any bounded, continuous func- 
tion D2 on K x H_2 x Dh_ 2 [0, oo) x X>r[0, oo), by the bounded convergence theorem and another 
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application of the continuous mapping theorem for F2 , 



lim E 



N- 



Fx (iw (t) , (tm (4 A,) , ^ , ^ , ^ (1))' 



Urn E 

N—hx 



E 



FxCiWct),^^))!^ 



-(AT) 



F 2 (^ 



S"o (1)) 



= E 



F 1 (B(t), M t (f))]E[F 2 (x N) , 9 ( Q N) , , 5^o" (l)) 



This completes the proof for the case when Assumption G3a) is satisfied. 

We now turn to the proof for the case when Assumption EJb) is satisfied. The proof in this case 
is similar, and so we only elaborate on the differences. First, for N G N, define = lS- N > / y/N, 
where now 



V Jo 

is the scaled and centered inhomogeneous Poisson process, and note that 



.17) 



FW(f) 



E iN \t) 



X(s)ds) =L( N \t)+ / P(s)ds 



Fix / that is bounded and continuous. To complete the proof of the proposition, it suffices to show 



that (L^ N \Mf>) =>■ (J Q ^/Ms)dB(s),M(f))- Let {J* t W } be the filtration defined in Claim 2 
above. Then, as is well known, {L^ N \t),^ N} ,t > 0} and {Mf\t),P t N \t > 0} are martingales. 
Hence, once again, we need only verify the conditions of the martingale central limit theorem (see 
Theorem 1.4 on page 339 of Ethier and Kurtz [ID]). Arguing exactly as in Claims 3 and 1 of 
the proof for case (a), it is clear that the jumps of E^ and are uniformly bounded by 

(1 + H/HooVV^V and for each t > 0, [M^]t — > Ap(t) in probability. Keeping in mind that 
the candidate limit (E,M.{f)) is a pair of independent, continuous Gaussian martingales with 
respective quadratic variations f Q X(s)ds and A pit), to complete the proof it suffices to verify that 
for every t £ [0, 00), as N — > 00, the following limits hold in probability: 



(8.18) 



/ X(s)ds, 



[L( N \Mf '] t -> 



Clearly, the {F t }-predictable quadratic variation of is given 



by (i( JV )) i = /„* AW ds, which 
converges to J * A(s) ds as N — > 00. By Theorem 3.11 of Chapter VIII of [17 , this implies that 
converges in law to J Q X(s)ds. Because the limit J Q X(s)ds is deterministic, the convergence 
is also in probability. This establishes the first limit in (|8 . 18|) . To establish the second limit, note 
that LW and M ( f N) are both compensated pure jump processes with continuous compensators, 
and so their optional quadratic covariation takes the form 



[£w Mf \ = A£alW( s )amW(.) = I^AFW( S )AQ 



s<t 



s<t 



Noting that AQ ( f N) < 



: 1 - 1I/II00 A.D( N taking expectations of both sides above and then the limit as 
N — > 00, Corollary IA. 21 shows that 



lim E 



-(N 



l/ll 



< lim il^°E 



^AFW(s)A£>W(s) 



= 0. 



An application of Markov's inequality then yields the second limit in (|8.18|) . The asymptotic 
independence from the initial conditions is proved exactly in the same way as when Assumption 
[3la) holds (see the proof of Claim 4) and is thus omitted. □ 
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8.3. Convergence of Stochastic Convolution Integrals. We now show that for suitable /, 
{W N ^(f)} NeN is a tight sequence of cadlag processes. Since each H^ N \f) is not a martingale, 
the proof is more involved than the corresponding result for {M.^ N ^ (f)~\ n &i and we require an 
additional regularity assumption (Assumption 0]) on G, which holds if the hazard rate function h 
is bounded and g is in L 1+Q for some a > (see Remark [Q]) . For conciseness, we will use the 
notation 

(8.19) G(x) = 1 - G(x), f~G(x) = f(x)G(x), x £ [0, oo). 
We first derive an elementary inequality. 

Lemma 8.5. Suppose Assumption^ is satisfied, let f be a bounded, Holder continuous function 
with constant Cf and exponent jf, and let 7^ = 7g A 7/. The family of operators {^t,t > 0} 
defined in . 1 9\ l satisfies, for all < t < t' < 00, 

(8.20) ||* t / - ^/lU < (C f + C G ll/IU \t - t'p'f. 

Moreover, if f G Hi then Cf < ||/|| H and there exists a constant Cq < 00, independent of f , such 
that the right-hand side of R8.20\) can be replaced by Co \t — i'| 7/ - 

Proof. Fix a bounded, Holder continuous function /, as in the statement of the lemma. Then we 
can write ^tf — ^t'f = ^ + 92 j where 

^) (x, s) = G{x+ ^- s)+) (f{x + (t- S )+) - f(x + (t> - .) + )) 



and 



(2) 



(x, S ) = f(x + (t'-s)+) 



G(x + (t- s)+) - G(x + (f - s)+) 
G(x) 



The Holder continuity of / and the fact that G is non- increasing show that \\tp^ II < Cf\t — 1'| 7/ , 
and Assumption[|]shows that ||<^ 2 ' l || 00 < Cq II/IIqo \t—t'\ 1G . When combined, these two inequalities 
yield (|8.20[) . If / e S, the Cauchy-Schwarz inequality implies 

i/w - f(f)\ = f /'(«) du < \\f\\ v (t - f) i/2 < ii/ii Hi it - tr /2 . 

Thus, Cf = Wf'W^ < H/lljj and 7/ = 1/2, respectively, serve as a Holder constant and exponent 
for /. When combined with (|1.2p this shows that / is bounded and Holder continuous and the 
second assertion of the lemma holds with Co = (1 + 4Cg). □ 

In what follows, for t > 0, let <d t ■ C&([0, L)) h-> C b ([0, L) x [0, t]) be the operator given by 



1.21) 



(&tf)(x,u) = / ($ s <p(-,s))(x,u)ds = / tp(x + s-u,s) 



1 - G(.t + s-u) 



ds 



1 - G(a:) 

for (x,u) £ [0,L) x [0, t] and / € Cb[0,L). The first two properties of the next lemma are used in 
Corollary 18.71 to establish convergence of the sequence {^ Ar '(/)jA r eN and regularity of the limit. 
The third property below is used in the proof of the Fubini type result in Lemma IE . 1 1 and the last 
property is used in the proof of Theorem 15.111 

Lemma 8.6. If Assumption^ is satisfied, the following properties hold: 

(1) Given a bounded and Holder continuous function f on [0, L), the sequence of processes 
{ - H^ Ar -'(/)}jvgN *s tight in Br[0,oo) and fi(f) is F-a.s. continuous. 

(2) There exists r > 2 and a constant Gq < 00 such that for any f G S, 



.22) 



sup J 

JV 



sup 

te[o,r] 



u[ N \f) 



< 



Coll/ll^ 
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(3) Suppose if : [0, L) x [0, oo) ^ M. is a Borel measurable function such that for every x £ [0, L), 
the function r i— > ip(x,r) is locally integrable and, for every t G [0,T], the function x t— > 
J ip(x, r) dr is bounded and Holder continuous with constant C Vj t o.nd exponent 7^,r (that 
is independent oft). ThenP almost surely, the random field {'Hs(Jq('p(- 7 r)) dr)) 7 s 7 t > 0} 
is jointly continuous in s and t. 

(4) Suppose ip € Cb([0, L) x [0, oo)). Then the process {M. t {Q t ip),t > 0} admits a continuous 



Proof. The proof of the lemma is based on a modification of the approach used in Walsh [35] 
to establish convergence of stochastic convolution integrals, tailored to the present context (the 
proof of Theorem 7.13 in [35] works with a different space of test functions and imposes different 
conditions on the martingale measure A4^ N \ and hence does not apply directly). Fix a bounded 
and Holder continuous / with constant Cf and exponent jf and fix T < oo. Recall from (|4.21l) 

that 111 (/) = Ai[ N \^tf), t > 0. The proof of the first two properties will be split into four 
main claims. 

Claim 1. For each N e N, {H.[ N \f),t > 0} admits a cadlag version. 

Proof of Claim 1. The estimates obtained in this proof are also used to establish the other 
claims. Fix feN and consider the following stochastic integral: 



.23) 



v t {N \f) 



te [o,T]. 



Because is a martingale measure, we have 



.24) 



te[o,T], 



which shows that the process {A4\ (^S>tf),t > 0} is a version of the optional projection of V^ N \f). 
It is well known from the general theory of stochastic processes (see, for example, Theorem 7.10 of 
Chapter V of Rogers and Williams [33]) that the optional projection of a continuous process is an 
adapted cadlag process. Therefore, to show that {M.[ N \^ t f), t € [0, T]} admits a cadlag version, 
it suffices to show that V^ N '(f) admits a continuous version. In turn, to establish continuity, it 
suffices to verify Kolmogorov's continuity criterion, namely, to show that there exist Ct < oo, 
9 > 1 and r < oo such that for every < t! < t < T, 



(8.25) 



E 



(N), 



(/) ^Cflt-t'f 



(see, for example, Corollary 1.2 of Walsh [3S]). Fix < t' < t < T and note that 



.26) 



v! N) (f)-V t )"'(f) = M^W-Vvf) 



Let r be any positive even integer greater than 1 /j'j . Together with (|8.3I) and (|8.20l) , this implies 
that (|8.25p is satisfied with 9 = r-f'f > 1 and 

(8.27) C f = C r (C f + C G ||/|| 0O )''((r/2)!^/ 2 (r) + 1). 

Claim 2. H(f) has a continuous version. 

Proof of Claim 2. Analogous to f03)l and (|8T24|) . we define V t (f) = M T {^tf), t > 0, and 
observe that 



.28) 



Ht(f)=Mt(Vtf)=V V t {f)\F t 



t > 0. 



Arguments analogous to those used in Claim 1, with the inequalities (|8.4|) and 
now playing the role of (18.31) and (18.1[) . can be used to show that 



respectively, 



.29) 



v t (f)-v tl (f) <c f \t-t'\ 
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with 9 — rj'f. Fix < t' < t < oo with \t — t'\ < 1 and a bounded, Holder continuous /. Using 
(18.281) and adding and subtracting M t '(^tf) = E [^t(/)l Ft'}, we obtain 



(8.30) 



H t (f)~HAf)=E V t {.f)-VAf)\T t , +Mttptf)-M v {p t f). 



Consider any even integer r > 2/7^ V 4 so that (|8.29|) holds with 9 > 2, let 9 = [r/2 A 9\ and note 
that 9 is an integer greater than or equal to 2. Taking first the rth power and then expectations 
of both sides of (|8.30|) . and using the inequality (x + y) r < 2 r (x r + y r ) and Jensen's inequality, we 
obtain 



E 



HAD - #t(/)| r ] < 2 r (e {\V t (f) - v t ,(f)\ r ] +E [\M t (v t <f) - MA^Af)[]) ■ 



Applying the estimates (|8.25|) . (|8.5|) and the fact that H^t/Hoo < ll/lloo: an d then the inequality 
x 2 + y 2 < (x + y) 2 for x, y > 0, this implies that 



E 



HAf)-Ht(f) < 2 r C f \t - t'\ § + 2 r C r (A^ t , f) 2(t) - A^ t , fr (t')) 



r/2 



< 



2 r (C f VC r \\f\\ 2 00 )(t + A 1 (t)-t>-A 1 (t')y 



Since t + A±(t) is a non-negative, increasing function of t, the generalized Kolmogorov's continuity 
criterion (see, for example, Corollary 3 of [27]) implies that H(f) has a continuous version. 
Claim 3. The estimate (|8.22|) is satisfied. 

Proof of Claim 3. From the proof of Corollary 1.2 of Walsh [3S] it is straightforward to deduce 
that (|8.25[) also implies that there exists a constant C r < 00, which depends on r but is independent 
of N and /, such that 



(8.32) 



E 



sup 

s£[0,T] 



Vj N \f) 



< C r Cf. 



By (|8.24[) and Jensen's inequality, for every t £ [0,T], 



t N) f)\ r < E 



sup 

s£[0,T] 



< E 



sup 

se[o,T] 



(JV) 



By (I8.32p . the last term above (viewed as a processs in t) is a martingale. So Doob's inequality 
and ([8T32]) imply that 



sup 

te[o,T] 



£ t w (/) 



< 



r - 1 

r 2 
r-l~ 



-E 



E 



sup 

se[o,T] 



(JV) 



-E 



sup |yW(/)r 

5£[0,T] 



< 



— C r Cf. 



If / G S then by the expression for Cf given in (|8.27p and the inequalities H/H^ < v6||/|| H and 
Cf < II/Hhj established in ()1.2[) and Lemma \8l5\ respectively, the right-hand side above can be 
replaced by Co ||/||Jj , for an appopriate constant Cq = Co(G,r,T) < co that is independent of N 
and /. Thus, (|5~2"2"j) follows. 

Claim 4. The sequence {H ( t N \f),t> 0} Nefi is tight in £> K [0,oo). 

Proof of Claim 4. We will prove the claim by verifying Aldous' criteria for tightness of stochastic 
processes. A minor modification of the arguments in Claims 1-3 shows that if Sn £ (0, 1) and Tjy 
is an {J-j } stopping time such that TV + Sn < T, then for any even integer r > 2, 



.33) 



E 
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Let S N € (0, 1) and let T N be an {F { t N) } stopping time such that T N + 6 N < T. Using (|8.24j) and 
(|8.23|) . the difference T-L^\ SN (f) — Hj^ (f) can be rewritten as 



E 



V, 



(N) 



Tn+$n' T n +8 



(N) 



E 



= E 
= E 



y(N) _y(N),j-(N) 
Tiv+t>iv Tjv I T N -\-S N 



v. 



(N) 



Tjv+5/. 



■E 



v± N) \4 N L 



v± N) \4 N) 

I TV I i JV 



* Tjv (/)(*, s)A^ (JV) (<ta,ds). 



[0,L)x(T JV ,T N +<5iv] 



Recalling the covariance functional of M^ specified in (14. 12)) and the fact that ||^Tjv(/)IIoo < 
ll/lloo' this implies that 



H 



(JV) 
Tjv + 



< 21 



<i 5jv (/)-^(/) 



+ 2 ||/||^ E [a^Vjv + S N ) - A[ N \T N ) 



<2C / 4 7; '+2||/||^su P E 



JV 



sup (A^^ + M-^C*) 
te[o,r] 



where the last equality uses (|8 . 33[) with r — 2. As <5jv — >> 0, the first term on the right-hand 
side clearly converges to zero, whereas Lemma 5.8(2) of Kaspi and Ramanan [55] shows that the 
second term also converges to zero. We conclude that W.^ +SN {f) — W-tL (/) converges to zero in 
L 2 , and hence in probability. On the other hand, (|8.22[) shows that the sequence {H^ N \f)} jveN 
is uniformly bounded in L r . We have thus verified Aldous' criteria (see, for example, Theorem 6.8 
of Walsh [35] ) , and hence the sequence {£ (a °(/)Wn is tight. 



We now turn to the proof of property 3. Fix T < oo, let tp be as stated in the lemma and for 
t € [0, T], define f^(x) = f* (p(x, r) dr. For s, t, s', t' € [0, T] with t' < t, we have 



H s (/*) - U a , (/*' ) = H s (/*) - U s > (/*) + M s 



tp(-, r) dr 



Due to the assumed boundedness and Holder continuity of /*, (|8.31[) and (|8 .4[) together with the 
above relation imply that there exists a sufficiently large integer r, constant C(T,r,ip) < oo and 
9 = 9(r, ip) > 1 such that 



E 



ip(-, r) dr 



</?(•, r) dr 



E 



U s ,(ft)-Hs(0 



< C(T, r,<p)(\8 + Ai(s) - s' - Ai(a')f + |< - i'|< 



Property 3 then follows from the generalized Kolmogorov's criterion for continuity of random fields. 

The proof of the last property of the lemma is similar to the proof of the continuity of % given in 
Claim 2, and so we only provide a rough sketch. Let Rt{<-p) = Mt(@tf), define Vt(v) = MriQtf) 
and note that Rt(f) — E[Vt(y)|J r t]. In a manner similar to (|8.30[) , we can write 



R t (<p)-R t ,(<p)=-E 



y s ipds | J", 



+ M t (Q t <p)-Mt> (e*¥>). 
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Using Jensen's inequality, (|8.4[) with r = 4 and the inequalities 
HQt'^IL < T H^ll^, it follows that for < t' < t < T, t - t' < 1 



ti^s^ds < |* — *'| Hvlloo and 



\Rt(<p)-Rt,(<P)\ 



< 



^ s tp ds 



< 2 4 C(T) Ml (\t tf + (A^t) - A^t')) 2 ) 

C{T) Mt ((t - t'f + {M (t) - M (t')) 2 ) 



< 2 



< 2 4 C(T)M i 00 (t-t' + A 1 (t)-A 1 (t')Y, 
where <?(T) = (2dU(T) 2 ) V T 4 . The claim then follows from the generalized Kolmo gorov conti- 



nuity criterion. 



□ 



Combining Lemma 18.61 with arguments similar to those used in the proof of Corollary 18.31 we 
now obtain the main convergence result of the section. 



Corollary 8.7. As N -t oo, K 



(JV) 



Yi in y±. Also, if for any bounded, Holder continuous f, 



(5~2T\> holds then (?} N) ,H (N] '(/)) => (%>#(/)) as N ^ oo. 

Proof. Fix N £ N. For k,k £ N, i = 1, ... ,k, j — 1, ... ,k, let fi and fj, respectively, be bounded, 
continuous and bounded, Holder continuous functions. Proposition 18 .41 and Lemma 18.61 imply that 
the sequence 

. . . ,MW(f- k ),H (N) (fi), ■ • • ,£ W (A)) Wn 

is tight in V m [0,oo) k+k . Since H { t N \f) = M [ t N) {^ t f) and, likewise, % t (/) = M t {^tf), Proposi- 



tion [8]4] also shows that for U,tj £ [0, oo), i = 1 
projections converge: 

(m\" ] (A), • • • , (A), ni^ (h ) 



, A;, j = 1, . . . , k, as N — > oo, the corresponding 



(A),..., jw 4 (A), £ tl (A), . . . , H th (/ fe )) 



Since S is a subset of the space of bounded and Holder continuous functions, together the last two 
statements show that 

(mW(/),^W(/),kW(a)) => (M(f)Mf)-Mh)) 

for f,f£S and A bounded and Holder continuous. Because S and S' are nuclear Frechet 
spaces, by Mitoma's theorem (see Corollary 2 of [27]) it follows that (M^ N \r2 (N \r2 w (fi)) => 

(M,U,U(fi)) in2? 5 40,oo) 2 x2? R [0,oo). Since ||-|| Hi < S ||-|| H , 3 and the estimate (gJ2j) holds, Corol- 
lary 6.16 of Walsh [35^ then shows that (A?W, WW,^W(A)) =^ {M,H,H(fi)) in X> H _ 2 [0, oo) 2 x 
2?r[0, oo), as AT — >• oo. Now, (H,H(fi)) is adapted to the filtration generated by M., and VVf is 
independent of {E,xq,Vq,S v ° ,S v °(1)) by Assumption [5] Thus, the same argument used to estab- 
lish asymptotic independence in Proposition 18.41 also shows that the convergence above can be 
strengthened to F X (JV) =>> Y x and (Y^ (f)) #(/)). □ 

9. Proofs of Main Theorems 

9.1. The Functional Central Limit Theorem. Before presenting the proof of Theorem 15.61 
we first establish the main convergence result. 

Proposition 9.1. Suppose Assumptions]])^ are satisfied and suppose that the fluid limit is either 
subcritical, critical or supercritical. Then the convergence 15.21]) holds and (K, X, has almost 
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surely continuous sample paths. Moreover, if g is continuous and V is defined as in {5.2$ , then as 
N -> oo, 

(9.1) ^.^^W.pCl.jcW.^fl)) {Y,K,X,vXX{l)) 
in y 1 x 2? R [0,oo) 2 x l£_ a [0,oo) x 2? R [0,oo). 

Proof. Corollary 18 . 71 shows that Y-[ N ^ Y% in J^i as N — > oo, which in particular implies that 

as A ^ oo. By Remark[5J] Assumption [5] and Lemma IQll). (£, 5 Po (1), H(l), 5 ?0 , "H) has almost 
surely continuous sample paths with values in R 3 + x HP 2 . Recalling the definition (|5~lUl) of y} N) 
and the fact that addition in the Skorokhod topology is continuous at points in C[0, oo), this implies 
that as N — > oo, 

(9.2) (y^\^W,4 w \5 p o"\l)-HW(l))^(f 1 J,S ,5 Po (l)-^(l)). 

By LemmaEl almost surely (^,1^,(1,^)) = A(B N \ x { "\ 5^"' (1) - for all 

N large enough. The continuity of A with respect to the uniform topology on 2?k[0, oo) established 
in Proposition 17.31 the measurability of A with respect to the Skorokhod topology on 2?r[0,oo) 
established in Lemma 17.41 and a generalized version of the continuous mapping theorem (see, for 
example, Theorem 10.2 of Chapter 3 of [TU]) then shows that the convergence (|5.21l) holds with 
(K,X,V(1)) = A(E, xq, (1) — 'H(l)). By the model assumptions and Lemma |4"7TI almost surely, 
AE (N 1(t) < 1 and AD^ N \t) < 1 for every t > 0. Combining this with ([23]), (|6T0l> and the second 
equation for in (|6.8p . it follows that almost surely for every t > 0, 

max(Aif( N )( i ),AlW(t),A(l,f ) )) < * 

v A 



Because jumps are continuous in the Skorokhod topology, the weak convergence of(ifW AW,PW( 
to (K, X, P(l)) established in (|9.ip shows that (AT, X, P(l)) is almost surely continuous. (Note that 
when g is continuous, the continuity of (K, X, is also guaranteed by Remark 1531 ) 

Next, suppose g is continuous. By Lemma ITTT 2). both the map V that takes K^ N ' to KS N ' and 
the map that takes to K^ N \l) is continuous (with respect to the Skorokhod topology on 

both the domain and range). So by (|5.21[) and the continuous mapping theorem, as N — > oo, 

(9.3) (y 1 w ,£W,jfW > => (Y, K, X, K, 

In turn, the representation (16.151) shows that v^ N ^> = S v ° ' — +K. < - N ' > and hence, is a continuous 
mapping of Y± N ^ and IC^ . Thus, (|9.3I) and another application of the continuous mapping theorem 
show that (I5.25P holds with v = S"° — % + K. Since this coincides with the definition of v given 
in (|5.24p . this establishes the proposition. □ 

We now prove the first two main results of the paper. 

Proof of Theorems ] 5.6] and \5.7\ The limit in (|5.21j) . the continuity of (K, X,u(l)) and Theorem 
15.71 follow from Proposition 19. II The relation (|6.16|) shows that 

" (h, 9f) ds = (1, z/W) - S pr (1) - M {N) (1) + n {N) (l) + [ K {N) (s)g(- - s) ds. 



The last term equals £W - £W(1), and so by LemmaO^) the mapping from AW to the last 
term is continuous. The limit (|5.21[) along with the continuous mapping theorem then shows that 
J (h,Ps) ds => D, where D is as defined in (|5.23p . The relation (16.61) for X^ N \ the continuity of 
the limit and another application of the continuous mapping theorem then yields the representation 
(|5.22p for X. This completes the proof of the theorem. □ 
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9.2. The Semimartingale Property. In view of the representation (|5.22j) for X and the fact 
that Ai\ and E are by definition semimartingales, to show that X is a semimartingale it suffices 
to show that D is a semimartingale. This is first carried out in Lemma 19.21 below. Throughout, 
we assume that Assumptions [T] [3l and [5j are satisfied, the fluid limit is subcritical, critical or 
supercritical and that, in addition, h is bounded and absolutely continuous. As stated in Remark 
15.21 if h is bounded then Assumptions [5] and @] are automatically satisfied. Thus, the results of 
Theorems 15.61 and 15.71 are valid. 

Lemma 9.2. Almost surely, the function t ^ D(t) is absolutely continuous and 

(9.4) a .e. te [0,oo). 

dt 

Proof. We start by rewriting the expression (|5.23|) for D obtained in Theorem 15.61 in a more 
convenient form. By the definitions of $t and 5"° given in (|5.6[) and (|5.11l) , respectively, for t > 0, 

vq{1) -S t °(l) = v Q \ — rr = vq / h(- + r)— — dr 



V l-G(-) J "\J " ' l-G(-) 



= v Q \J <S> r h{-)dr 

By (|5.7[) and the boundedness of h, $> r h is bounded (uniformly in r) and absolutely continuous, and 
Assumption [4] implies that f Q <& r hdr = (1 — G(- + r))/{\ — G(-j) is Holder continuous. Therefore, 
applying Assumption [51(d) with ip = $ r h, it follows that 

(9.5) z/ (l) -Sf°(l) = f V (<l>rh)dr= f S v r °{h)dr. 

Jo Jo 

In a similar fashion, for t > 0, using the identity "Ht(l) = M. t {^ t \) we have 



#.(1)- 72,(1) = // G{X+ iIg\x) G{X) U{AX,dU) 

[0,L)x[0,t] 

1 h(x + r-u)(l -G(x + r-u) \ n , 

i - G(x) y 

[0,i)x[0,t] 

Because h £ C&[0, £), we can set </3 = h in (|E.1|) of Lemma \E. II to obtain 

(9.6) M(l)-Wt(l)= / Hr(h)dr. 

Jo 

If is absolutely continuous, then g is absolutely continuous and by the commutativity of 
the convolution and differentiation operations, the function t i— > J g(t — s)K(s) ds is absolutely 
continuous with derivative g(0)K(t) + f Q g'{t — s)K{s)ds. Together with the relations (|9 . 5|) and 
(|9.6p and the definition (|5 . 23[) of D, it follows that almost surely, D is absolutely continuous with 
respect to Lebesgue measure, and has density equal to 



dV t 
dt 



Sf°{h)-n t (h)+g{0)K{t)+ / g'(t-s)K(s)ds 



The relation (I9.4[) then follows on comparing the right-hand side above with the right-hand side of 
the equation (|5.24l) for v{f), setting f = h therein and using the elementary relations h(0) = g(0) 
and g' = h'(l - G) - hg. □ 
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Proof of Theorem \5.8\ From Lemma 19.21 and the discussion prior to it, it follows that X is a 
scmimartingale with the decomposition stated in Theorem l5.81 Combining the non-idling condition 
(|6.10l) with the equation (|6.8p for K, it follows that 

E(t) if X is subcritical, 

(9.7) K{t) = { E(t) +x - X(t) V if X is critical, 

E(t) +xq— X{t) if X is supercritical. 

Thus, in the subcritical case, the semimartingale decomposition of K follows from that of E (see 
Remark l5.1|) . whereas in the supercritical case the semimartingale decomposition of K follows from 
those of X and E. On the other hand, when X is critical we need the additional observation that 
by Tanaka's formula, 

(9.8) X(t) V0^„V0 + | l {jf {s)>0] dX s + hf(0), 

where Lf(0) is the local time of X at zero, over the interval [0, t]. When combined with (I9.7[) . this 
provides the semimartingale decomposition of K in the critical case. When K is a, semimartingale, 
the stochastic integration by parts formula for semimartingales shows that for every / £ ACb(£), 

(9.9) £.(/) = / f(s-u)(l-G(s-u))dK(u), s>0, 

J[0,s] 

where the latter is the convolution integral with respect to the semimartingale K. Thus, we obtain 
ESSE from (Oil) . □ 

Sketch of Justification of Remark \5.9[ By Corollary 18. 71 if / is bounded and Holder continuous, 
then j-L^ N \f) =>■ 'H(f) in 2?r[0,oo) and {%t(f),t > 0} is a continuous process. We now argue 
that one can, in fact, show that TC^ N \f) K,{f) as N — > oo for all Holder continuous /. Given 
the semimartingale decomposition K — M K + A , the integral on the right-hand side of the 
expression (|9.9I) for IC(f) can be decomposed into a stochastic convolution integral with respect 
to the local martingale M K and a Lebesgue-Stieltjes convolution integral with respect to the 
finite variation process A . An argument exactly analogous to the one used in Lemma 18. 6f 1) 
to analyze H(f) can then be used to analyze the stochastic convolution integral with respect to 
M K and a similar, though simpler, argument can be used to study the convolution integral with 
respect to A K to show, as in Lemma 18.61 and Corollary 18.71 that for / Holder continuous and 
bounded, =► fC(f) as N oo, and /C(/) admits a continuous version. When combined 

with the convergence in (|5.27j) . it is easy to argue as in the proof of Theorem 15.61 that, in fact, 

the joint convergence (S p o N) (/),£W(/),-H W (/)) {S Va (f)X(f)S{f)) holds. Due to (|5T5l) . 
by the continuous mapping theorem, this implies that v^ N \f) => *?(/) in 2?r[0,oo), where v(f) is 
continuous. □ 

9.3. Stochastic Age Equation. The focus of this section is the characterization of the limiting 
state process in terms of a stochastic partial differential equation (SPDE), which we have called 
the stochastic age equation in Definition l5.101 First, in Section 19.3.1 1 we establish a representation 
for integrals of functionals of the limiting centered age process {v s ,s > 0}. This representation 
is then used in Section [9.3.21 to show that {vt,t > 0} is a solution to the stochastic age equation 
associated with (Dq,K, Xi). The proof of uniqueness of solutions to the stochastic age equation 
and the proof of Theorem l5.11f 1) is presented in Section l9.3.31 Throughout the section we assume 
that the conditions of Theorem 15. 11) namely Assumptions [lj [3] and [5j, the conditions on the fluid 
limit and the boundedness and absolute continuity of h, are satisfied and state only additional 
assumptions when imposed. 
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9.3.1. An Integral Representation. We start by establishing an integral representation that results 
from the semimartingale property for K. In what follows, recall the definition of the operator 
®t given in (|8.21l) . Also, note that if h is bounded then Assumption [5] and (by Remark 15.21) 
Assumption @] are both satisfied. Since h is also absolutely continuous, by Theorem 15.81 if is a 
semimartingale and Pt{f) is given by (15.26[) for every / £ >4Cb[0, L). 

Lemma 9.3. For any tp £ Cb{[0,L) x [0, oo) such that </?(•, i) is Holder continuous uniformly in t 
and absolutely continuous, F-almost surely for every t > 0, we have 

(9.io) / £,(¥>(■,«)) da = % (e t (^o, «))(-, o))-^t t (e t ^) 



ip(s — u, s)(l — G(s — u)) dsj dK(u). 

Proof. Setting t = s and / = </?(•, s) in (|5.26|) . then using the identities S"° — ^o(^V)s ^» = 
A^ S ( V I' S -) and (I9.9|) and lastly integrating over s £ [0,t], we obtain 

(9.11) / V 3 (ip(;s)) ds = [ U ($ a <p(;s)) ds - [ M s (^ 3 <p(; s)) ds 



tp(s — u, s)(l — G(s — u)) dK{u) ds. 

[0,*] \J[0,s] ' J 

From the definition flOTj) of 6 t and the fact that (* t /)(-,0) = it follows that 

e t (vj(-,*))(s,0)= / (9,<p(;a))(x,0)da= f $ a (<p{;s))(x)ds. 
Jo Jo 

Together with Assumption [5j(d), this implies that 

(9.12) / Pb ($ fl¥ >(., s )) ds = Pb(e t (^(-,s))(-,0), 



which shows that the first terms on the right-hand sides of (|9.10p and (|9.11j) are equal. The 
corresponding equality of the second terms on the right-hand sides of (|9.10j) and ([9. lip follows 
from (|E.1[) . whereas the equality of the third terms follows from Fubini's theorem for stochastic 
integrals with respect to semimartingales (see, for example, (5.17) of Revuz and Yor pH])- This 
completes the proof of the lemma. □ 



9.3.2. A Verification Lemma. We now show that the process v of Theorem 15 .71 is a solution to the 
stochastic age equation. For this, it will be convenient to introduce the function defined as 
follows: iph{x,t) = exp(rfi(x,t)) for (x,t) £ [0, L) x R + , where 



(9.13) r h (x,t) = 



Since h = g/(l — G), this implies that 



h(u) du if < t < x, 
h{u) du if < x < t. 



1-G(x) 

if < t < x. 



(9.14) i> h (x,t) = { l-G(x-t) 

l-G(x) ii0<x<t. 

If g is absolutely continuous, then G is continuously diffcrcntiable and iph is bounded, absolutely 
continuous and satisfies 
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for a.e. (x,t) £ [0, L) x R + . Furthermore, from the definition it is easy to see that i/jh(0,s) = 
ifjh(x, 0) = 1 and, for (x, s) £ [0, L) x [0, oo) and u £ [0, s], 

i i \ t s~t/ \ ( 1 G(x + s ) 
, . iphjx + s-u,s) _ 1 - G(x + s-u) _ J — ifu = 0, 

( } M*,») = i -<?(*) -\ if, = o. 

Proposition 9.4. If h is Holder continuous, then the process {vt,t > 0} defined by h5.26\) satisfies 
the stochastic age equation associated with {v ,K, M}. 

Proof. Theorem l5 . 1 1 I shows that for every t > 0, {v t (f), f £ ACb[0, L)} is a family of J-j-measurable 
random variables and \v t ,t > 0} admits a version as an {J-" t }-adapted continuous, H_2-valued 
process. Moreover, it follows from Lemma ETbl that for every / £ ACb[0, L), almost surely s i-> v s {f) 
is measurable. Therefore, it only remains to show that v satisfies the equation (15.281) . Fix t £ [0, oo) 
and tp £ C. ' ([0, L) x [0, oo)) such that <p x ('i s ) + ( i 5 s(' J s ) is Lipschitz continuous for every s. Since h 
is bounded, Holder continuous and absolutely continuous, it follows that ip x + ip s — hip is bounded, 
Holder continuous and absolutely continuous. Moreover, it is clear from (|9.15|) that 

(ip x + ip s - h<p) ip h = (ipi>h) x + {v>^h)s- 
Substituting this and the identity (|9. 16|) into the definition (|8.21|) of 8t, it follows that 

rat , l 1U \ f* ((fx + <£s - hip)ip h ) (x + s-u,s) 
{Qt{<Px + <Ps - h<p)){x,u) = / — r ds 

* {{<pil>h)x + ( l P'4'h)s) (X + S-U,S) 

4>h(x,u) 

<p(x + t-u,t)tp h (x + t-u,t) 

(9.17) = — ip(x,u). 

iph{x,u) 

Applying Lemma 19.31 with ip replaced by tp x + <p s — hip, using (|9.17p and the identity iph{0, u) = 1, 
it follows that 

ft 

v s (<p x (; s) + ip s (-,s) - hip(-,s)) ds 



= V {<p(- + t, t)ij) h {- + 1, t)) + J tp(t- u, t)ip h (t - u, t)dK(u) 

O- 18 ) - / / ipjx + t-u, ^^-^ M(dx,du) 

J J tPh{x,u) 

[0,i)x[0,i] 



-V (ip(-,0)) - / ip(0, u) dK(u) + / / (p(x,u)M(dx,du). 
J[o,t] J J 

[0,L)x[0,t] 

Since ip is bounded and x i— > ip(x, s) is absolutely continuous for every s, by the definition (|5.26p of 
Vt and the identities in (I9.16[) , it is clear that the sum of the first three terms on the right-hand side 
of (|9.18l) equals vt{f{-,t)). With this substitution, (|9.18p reduces to the stochastic age equation 
(15.281) . This completes the proof that {v t ,t > 0} is a solution to the stochastic age equation 
associated with (P , K, M). □ 

9.3.3. Uniqueness of Solutions to the Stochastic Age Equation. In order to establish uniqueness, 
we begin with a basic "variation of constants" transformation result. Recall from Section 11.4.11 
that S c is the space of C°° functions with compact support on [0, L) equipped with the same norm 
as S. In what follows g' is the density of g. 

Lemma 9.5. Suppose that g' £ Lf oc [0, L)U£^ c [0, L). Given a solution {vt,t > 0} to the stochastic 
age equation associated with (Vq, K,M), define 

(9-19) Ml) = ^(/(l ~ G)- 1 ), f £ S c . 
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Then {fit,t > 0} is a continuous S' c -valued process that satisfies the following stochastic transport 
equation associated with (P , K, M): for every f £ S' c , t > 0, 

(9.20) Mf) = P (f(l-G)- 1 ) + J o /*.(/«) *» + /(0)^(*)-^tt (/(I 



Proof. By the definition of the stochastic age equation, {vt,t > 0} is a continuous H_2-valued 
process. By the assumptions on the service distribution G and Lemma IB. 11 it follows that / = 
f(l — G) _1 is an absolutely continuous function with compact support and hence lies in H 2 . 
Therefore, fit(f) is a well defined random variable for every / £ S c , t > 0. Moreover, / has 
derivative 

(9.21) f x = f x (l - G)- 1 + hf. 

Since / £ C^[0,L), we can substitute <p = f in the stochastic age equation (|5.28p . use (|9.21[) and 
the identity 1 — G(0) = 1 to obtain for t > 0, 

(9.22) = ^ (/(l - G)- 1 ) - ^(/(l - G)- 1 ) + jf ^ (7,(1 - G)- 1 ) d S 

+/(0)£(f) - M t (/(1 - G)" 1 ). 



Due to the continuity of X and A4, it follows that the right-hand side is continuous in t, which 
in turn implies that t H ► fXt(f) is continuous for each f £ S c . Since 5£ is a Frechet nuclear 
space, by Mitoma's theorem \i is a continuous 5^-space valued process. Moreover, by (|9.19l) 

— G) _1 ^j = /i s (/ x ). Substituting this back into (I9.22[) . it follows that {/it,f > 0} sat- 
isfies dQD]) . □ 

We can now wrap up the proof of Theorem 15.111 

Proof of Theorem \5.11l By assumption, h is Holder continuous. Therefore, Proposition 19.41 shows 
that {v tl t > 0} is a solution to the stochastic age equation associated with (d 0} K,M). Thus, in 
order to establish the theorem, it suffices to show that the stochastic age equation has a unique 
solution. Suppose that the stochastic age equation associated with (Do, K, M.) has two solutions 
i/ 1 ) and and for i = 1, 2, let /^M be the corresponding continuous 5^-valued process denned as 
in (|9.19j) . but with v replaced by v^ l \ By Lemma T9.51 each fjy^ satisfies the stochastic transport 
equation (|9.20[) associated with (Do,K,A4). Define rj = /i' 1 ) — /j( 2 \ It follows that for every / in 

f t {f,vt}-{l,m)=o, (/,»»> = o. 

However, this is simply a deterministic transport equation and it is well known that the unique 
solution to this equation is the identically zero solution rj = (see, for example, Theorem 4 on 
page 408 of [IT]). 

Thus, for every / £ S c , M (/) = M (/) or equivalently, 

(9.23) ^(/(l - G)- 1 ) = ^(/(l - G)- 1 ). 

Now for any / £ S c , /(l — G) <G H2. Since 5 C is dense in H2 (see Theorem 3.18 on page 54 of [TJ), 
there exists a sequence f n £ S c such that f n —> f(l — G) in H2 as n — > 00. Replacing / by /„ in 
(|9.23p and then letting n — > 00, it follows that v[ 1 \f) — v\ f (f) for every / £ S c . Again using the 
fact that S c is dense in H 2 , this shows and vf^ are indistinguishable as H_ 2 -valued elements. 
This proves uniqueness of solutions to the stochastic age equation and the theorem follows. □ 
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9.4. The Strong Markov Property. To prove the strong Markov property, we first show that 
the assumptions on the initial centered age distribution imposed in Assumption [5] are consistent, 
in the sense that they imply that these assumptions are also satisfied at any future time s > 0. We 
define the following shifted processes: for F = E^ N \k^ N \E, K, and U = M^ N \M, and s > 0, 
u > 0, 

(9.24) (e s F)(u)=F(s + u)-F(s), {Q S U) U = U s+U - U a , 
for / € Cb[0, L), we define 

(9.25) (e,«W),(/) = (9^) t (* t /), (e s H) t (f) = (Q a M)t(*tf), 

(9.26) (e s £W) t (/) - / (l-G(t-u))f(t-u)d(® s K^)(u) 

J[0,t] 

(9.27) (QslCW) = f(0)(e s K)(t) + f (Q s K)(u)<p f (t-u)du, 

Jo 

and, in analogy with (|5.f f I) , for / G ACb[0,L) we define 

(9-28) Sf'(/)=£(*t/), s,t>0. 

Lemma 9.6. For every bounded and continuous f, 

(9.29) D^{f) = sf\f) + {Q s Z (N) W)-{<d s n (N) W): s,t>0. 

Likewise, if Assumptions EHU hold and g is continuous, then for every bounded and absolutely 
continuous f , 

(9.30) d s+t (f) = sf*(f) + (e s ic) t (f)-(e s H) t (f), s,t>o. 

In addition, for every s > 0, 

(9.31) (e s K,X s+ .,9 s+ .(l)) = f\(G s E,X(s),S v °(l) - (0.W)(1)). 

Furthermore, for every s > 0, Assumption^' holds with the sequence {Pq }jveN an d limit vq, 
respectively, replaced by {ps }iVeN andv s . 

We defer the proof of this lemma to Appendix [Ej and instead now prove the strong Markov 
property of the state process. 

Proof of Theorem ^. 11V 2). Fix s,t > 0. First, note that by Theorem 15771 it follows that (X, u) is an 
K x H_2-valued process. Moreover, by Lemma [9~6l Assumption [5] is satisfied with vq replaced by 
v s , which in particular implies that the random element S"l,(l) — {<S£? U (1), u > 0} almost surely 
takes values in Cr[0, oo). Also, let (0 s %)i($.l) represent the process {(0 s ?{)t($„l), u > 0}. 
Writing <& u l = f $ r h(-) dr and observing that $ u l is bounded and (due to Assumption [4| 

Holder continuous uniformly in u, it follows from Lemma I8.6f 3') (with J\4 replaced by S .M) 
that the random element (Q s H)t(^.l) takes values in Cr[0,oo). In addition, Assumption [3] and 
Corollary 18.71 show that & S E and Qs'H are, respectively, Cr[0, oo)-valued and Ch_ 2 [0, oo)-valued. 
We now claim that there exists a continuous mapping from K x H_2 x Cr[0, oo) 3 x Ch_ 2 [0, oo) to 
K x H_ 2 x Cr[0,oo), which we denote by A = A t , such that P-almost surely, 

(9.32) (x s+t ,v s+t ,s»°+*(i)) = A^x{s),v s ,s^{i),e s E,{e s n)t^.i),&sn) ■ 

To see why this is the case, first note that equation (|9.30p shows that v s +t is the sum of (Q S T-L) tl 
Sf 3 and (0 s /C)j and, by Lemma fB.lf 2). S^ 3 is a continuous functional of v s . Also, for u > 0, <F U 1 
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is bounded and absolutely continuous. Hence, by ()9.30|) . the definition of <S" and the semigroup 
property for $, P-almost surely, for u,s,t > 0, 

£^+'(1) = 5f-($„i) + (e s £) t ($„i)-(e s ^) t ($„i) 

= S£„(l) + (e.£) t (<M) - (& s H)t(<i>ul). 

Next, note that (|9.31|) of Lemma l9.6[ Proposition 17.31 and the continuity of X show that X s+t 
is a continuous functional of (Q S E, X(s), S" 3 (1) — ® S W(1)). Furthermore, due to the almost 
sure continuity of K established in Theorem 15.61 definitions (|7.1[) and (|9.27p of JC and (Q S K), 
respectively, and properties 2 and 3 of Lemma l7.ll it follows that 8 S /C and u i-> (8 S /C)t($ u l) are 
almost surely obtained as continuous mappings of Q S K. In turn, by (|9.31|) of Lemma l9~B"l <d s K = 
A(Q S E, X(s), S" 3 (1) — S "H(1)), where A is continuous by Proposition 17.31 When combined, the 
above observations show that the claim (|9.32p holds, with A a suitable continuous mapping. 

We now show that the claim implies the Markov property. First, from (15.41) we observe that & S E 
is adapted to the filtration generated by <d s B and, likewise, (|9.25p shows that QsH is adapted to 
the filtration generated by Q s Xi. Moreover, by the definition of B as a standard Brownian motion 
and the definition of Ai (see Section 14.31 and Remark I5.1[) . both B and M. are processes with 
independent increments with respect to the filtration {Tt,t > 0}, which is the right continuous 
completion of {cr(d ,X(0)) V a(B s ,M s ,s >t),t> 0}. In particular, this implies that Q S B, Q s T-l 
and u h-> (0 s %)t($ u l) are independent of T a . Therefore, for any bounded continuous function F 
on [0,oo) x (K x H_ 2 x C R [0,oo)), 

E[F(s,X s+u P s+t ,S»°+t(l))\? s ] 

= E\F{s,^x(s),p s ,s^(i),e s E,(e s n)t(^),e s u(i)))\^ a 

= e F(s,K(x( s ),v s ,s V3 (i),e s E,(eS)t(^-i),e s n(i)))\x(s),9 s ,s V3 (i) 

= E[F{s, X s+t ,i) s+t , S» 3 +* (l))|X(s), u.,S p ' (1)]. 

This shows that {(X s , v s , S u " (1)), iF s , s > 0} is a Markov process. 

By Theorems 15.61 and 15.71 the sample paths s H> (X(s), 9 S , S u " (1)) taking values in the state 
space R x H_2 x Ch_ 2 [0, oo) are continuous. Since the state space is a complete, separable metric 
space, there exists a Markov kernel P : M+ x (R x H_ 2 x C R [0,oo)) x R+ x B(R x H_ 2 ) i-> 
[0,1] such that for any (x,v,tp) 6 (R x H_2 x Cr[0, oo)), and any measurable function F on 
R+ x (R x e_ 2 x C K [0,oo)), 

E[^( s ,A s+t ,P s+t ,5 p ^(l))|(A( s ),9 s ,^(l)) = {x,vrf)\ 

F(s, u)P(s, (x, v, ip), t, du). 

.xH„ 2 

Now, when F is bounded and continuous, it follows from (|9.32[) and the continuity of A established 
above that the mapping from (x, is, "0) to the term on the right-hand side of the last display is 
continuous. This implies that the Markov kernel is Feller, and it follows from Theorem 2.4 of 
Friedman [T2] that {(X s , v a , S u - (1)), T s , s > 0} is a strong Markov process (see also Theorem 
7.4 of Chapter I of [33] for the time-homogeneous case, which would be applicable if the arrival 
process satisfies Assumption [3ja) and the fluid age measure starts at the equilibrium measure so 
that v s (dx) = (1 — G(x)) dx and X(s) = 1, s > 0, leading to a critical fluid limit) □ 

Remark 9.7. A more natural candidate for the (strong) Markov process would be the process 
{(X t , u-t), Tt, t > 0} taking values in R x H_2. However, in order to establish the Markov property, 
we need S v ' and S" 3 (1) to be measurable functions of v s . As shown in Lemma \B.1\ the additional 
boundedness assumption on g' / (1 — G)) ensures that the map from HL2 i-> 2?h_ 2 [0, 00) that takes 
v s to S Vs is continuous. This is a reasonable assumption because, as noted in Remark 15. 121 it 
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is satisfied by a large class of distributions of interest. However, unfortunately, it appears that 
measurability of the map from H_2 to 2?r[0,oo) that takes v s to S v "(l) = V S (Q S 1), which would 
require that $ s l lies in H2, cannot be obtained without imposing too severe assumptions on 
the service distribution G. Although $ s l £ ACb[0,L) and {v s (f),f € ACb[0,L)} is a well defined 
collection of random variables, it is not clear whether it is possible to show that v s admits a version 
that takes values in the dual of some space that contains $ s l and such that the dual space admits 
a regular conditional probability so as to enable the construction of the Markov kernel. Instead, 
we resolve this issue by appending the 2?r[0, oo)-valued process S Vs (l) to the state descriptor. 

Appendix A. Properties of the Martingle Measure Sequence 

A.l. Proof of the Martingale Measure Property. Recall that Bo[0,L) is the algebra gen- 
erated by the intervals [0,x], x £ [0,L). We now show that the collection of random variables 
{M[ N) {B);t > 0,B £ B Q [0,L)} introduced in flO} defines a martingale measure. 

Lemma A.l. For each N £ N, M {N) = {M ( t N) (B), J ri t N) ;t > 0,B £ B [0,L)} is a martingale 
measure on [0,L). Moreover, for every B <= So[0, L) and t £ [0, 00), 

21 r r* / r \ 1 

h(x)v[ N) (dx) ds 



(A.1) 



M[ N \B) 



E 



Proof. In order to show that {M.\ (B); t > 0,B £ Bq [0, L)} defines a martingale measure on [0,L), 
we verify the three properties stated in the definition of a martingale measure given on page 287 of 
Walsh [35]. The first property in [35], namely that M ( N) (B) = for every B £ Bq, follows trivially 
from the definition. Next, we verify the third property, which states that {M.\ (B), T\ t > 0} 
is a local martingale for each B £ Bq. For this, first observe that any B £ Bo[0,L) is the union 
of a finite number of disjoint intervals ij, i = 1, . . . , k, where each Ii is of the form (a,i, L), (pn, /3j] 
or [0,/?i], with < cti < /3i < L. For any such interval Ii, it is clear from the definition of the 
age process given in (|2.5I) that for every j, the function s H> U/ 4 (a^ (s)) defines a bounded, left 

continuous function on [0, 00). In turn, since Is = 53i=i -"-A' clearly the function s t— > B.s(fflj- (s)) 
is also bounded and left continuous. By Lemma 5.2 of Kang and Ramanan [20] . it then follows 
that for every B £ Bo[0, L), {M\ N \B),t > 0} is an {J 7 ^ ^'j-martingale obtained as a compensated 
sum of jumps, where the compensator A^J is continuous. Standard arguments (see, for example, 
the proof of Lemma 5.9 in Kaspi and Ramanan [22]) then show that (M^ N \B)} , the predictable 
quadratic variation ofM^(B), equals A { fJ . Since E[A^ B \t)] is dominated by E[Z>W(t)], which 
is finite by Lemma 5.6 of Kaspi and Ramanan [55], the relation (|A.1[) follows. On the other 
hand, because {v[ N \t > 0} is an Mj? [0, L)-valued process, this shows that the set function B H> 
E[(M ( t N) (B)) 2 } is countably additive on B o [0,L), and hence defines a finite L 2 (ft, F<- N \ P)-valued 
measure. This verifies the second property in [35] . and thus completes the proof of the lemma. □ 

A. 2. Proof of Lemma 14.11 As we will show below, Lemma [4.11 is essentially a consequence of 
the strong Markov property of the state process, the continuity of the {^j-compensator of the 
departure process and the independence assumptions on the service times and arrival process. 

Fix N £ N and, for conciseness, we suppress N from the notation. We shall first prove (|4.6[) . 
namely we will show that almost surely, AD (t) < 1 for every £ e [0,oo). For k = — (1, 2/o)+lj . . ., let 
Eu denote the event that the departure time of customer k lies in the set of the union of departure 
times of customers j, j < k. To establish (|4.6p . it is clearly sufficient to show that P(£fc) = for 
every k. Fix k £ N and let 9t be the {J^j-stopping time 

6 k = iv£{t : K{t) = k}. 

Now, consider a modified system with initial data v$ = i>$ k , X(0) = (1, vg k ) and E = 0. By Lemma 

B. l of Kang and Ramanan [5^, {(RE{t),X(t),v t ),t > 0} is a strong Markov process. Therefore, 
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conditioned on J 7 e h , the departure times of customers j, j < fc, only depend on {a,j(6k),j < fc} 
and are independent of arrivals after 9k . Consequently, the probability of the event £ k is equal in 
both the original and modified systems. In the modified system, let {a.,(s),s £ [0,oo)} denote the 
age process of customer j for j < fc, let D 6k (s) denote the cumulative departures in the time [0, s] 
of all customers other than customer fc and let J k = {s £ [0, oo) : D 6k (s) ^ D° k (s— )} be the jump 
times of D 6k . Also, let G k = a(a,j(s),j < k,s £ [0,t]) and let {G k ,t > 0} be the right continuous 
completion (with respect to P) of {G k ,t > 0}. By the assumed independence of the service times 
for different customers and the fact that afe(0) = 0, the departure time Vk of customer fc in the 
modified system has cumulative distribution function G and is independent of J k . Therefore, 

P(£ k ) = P(i t eJ fc ) 

( A - 2 ) = f P(t e J k \i k = t)dG(t) = [ P(t e J k )dG{t), 

J[0,L) J[0,L) 

where the last equality follows from the independence of Vk and Jk- The same logic used in 
Lemma 5.4 of Kaspi and Ramanan [22] to identify the compensator of D also shows that the 
{Gt }-compensator of D 0k equals 

8 ) \ 

v' {dx) ds, where u' = — 6q, 




where the mass at zero is deleted from the modified age measure to remove customer fc, which 
has age zero at time in the modified system. By the continuity of the {£/ t fe }-compensator of 
D 6k , D 9k is quasi-left-continuous and so AD 6k (T) = for every {C/ t fc }-predictable time T (see, for 
example, Theorem 4.2 and Definition 2.25 of Chapter I of Jacod and Shiryaev [IT). Choosing T 
to be the deterministic time t, this implies that P(t £ J k ) = for every t > 0. When substituted 
into (IA.2I) . this shows that P(£fc) = 0. For fc < 0, we set 9k = and observe that, conditioned 
on J 7 !), the departure time Vk of the fcth customer has cumulative distribution function G(-) = 
(G(-) - G(a fe (0))/(1 - G(a fc (0)), rather than G, so that (TOl holds with G replaced by G. The 
rest of the proof follows exactly as in the case fc > 0, and thus (|4.6[) holds. 

We now turn to the proof of (|4.7[) . Fix r,s £ [0, oo), recall that D r (s) is the cumulative 
departures in the interval [r, r + s) of customers that entered service at or before time r, define J r 
to be the jump times of D r in [0, oo) and let Gt = J~r+t, t £ [0,oo). Using the same logic as in 
the proof of (|4.6|) . it can be shown that {D r (t),t > 0} has a continuous {t/ t }-compensator, given 
explicitly by 

g x -r °) ' Vr [dx) \ ds, 4€[0,oo), 
I[0,L) 1 _ G ( x > J 

and hence has no fixed jump times, i.e., P(t £ J r \F r ) — for every t £ R+. Moreover, due 
to the assumption of independence of the arrival processes and the service times, {E(t)}t> r and 
{D r (t),t > 0} are conditionally independent, given T T . Let 

T={i= (<i, . . . , t m , ...) £ : < <i < t 2 < ...}, 

and let T denote the random T- valued sequence of times after r at which E has a jump. Moreover, 
let /j, denote the conditional probability distribution of T , given T r . Then, for any t £ T, using 
the fact that < AE(t) < 1, we have 




E 



J2 AE(r + s)AD r (s)\F r ,T r =t 

se[o,oo) 



^E[AD r (t)|J- r ,T r = t] 
tet 
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where the second equality uses the conditional independence of {D r (t),t > 0} from T given 
J- r , and the last equality follows because as argued above, conditional on J>, D r almost surely 
has no fixed jumps. In turn, integrating the left-hand side above with respect to the conditional 
distribution /i and then taking expectations, it follows that 



E 



= 0. 



AE(r + s)AD r (s) 

s£[0,oo) 

Since the term inside the expectation is non- negative, this proves (14. 7|) . 

A. 3. A Consequence of Lemma 14.11 We now establish a consequence of Lemma 14.11 which 
will be used in the proof of the asymptotic independence property in Section [ 

Corollary A. 2. 4sJV^ oo. 



N 



-> 0. 



Proof. With the aim of computing the left-hand side above, using the same notation as in Lemma 
4.11 for r > and s > r, let D^ N '' r (s) denote the cumulative number of departures during (r, s] of 
customers that entered service at or before time r, and let D( N > + ' r (s) be the cumulative number 
departures during (r, s] of customers that have entered service after time r. Then for S > and 



k = 1, 2, . . ., we have 



Y A£jW( S )A£>W(s) 

se(fe<5,0+l)<5] 



Y AE^(s)AD^ kS (s) 

s£(kS,{k+l)S] 

+ Y AE^ N Hs)AD^+' kS ( s ) 

s<E(fc<5,(fc+l)(5] 

The first summand on the right-hand side above is almost surely zero by (|4.7| of Lemma [4~TI Using 
the fact that E^ has unit jump sizes to bound the second term, we obtain 

(A.3) Y AE^ N \ S )AD (N \ S ) < Y AD^+' kS (s) 

se(kS,(k+l)S\ se(kS,(k+l)S] 

K (N '((fc+l)5) 

^ H> 3 <<5}- 

j=ffW (fc5)+l 

Summing (|A.3|) over k = 1, . . . , [t/S\ and dividing by N, we obtain 



1 

N 



E 



Y,AE( n \s)ADW(s) 



< 



1 {v Km , a) <s}dK N (s) 



< E 



<C (* + *)' 



For each S > 0, let f$ be any continuous bounded function on [0, L) such that l[o,<s) < fs < l[o,2<5)- 
Then we have 



1 

N~ 



-E 



Y,AEW(s)ADW(s) 



< E 



On both sides, taking first the limit supremum as N — > oo, and then the limit as 6 J. 0, we then 
conclude that 



lim sup — E 

jV->oo N 



Y&eW(s)AdW(s) 



s<t 



< lim lim sup E 

54.0 AT^oo 



0. 



were the last equality follows from Lemma 5.8(3) of Kaspi and Ramanan 



□ 
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Appendix B. Ramifications of Assumptions on the Service Distribution 

Lemma B.l. Suppose h is uniformly bounded. Then Assumptions^ and^ are satisfied. If in 
addition, g is absolutely continuous and g' is either locally essentially bounded or g' £ l}^ '■ Then 
for any f £ S c , f = /(l — G) -1 £ Ha. Moreover, if g is absolutely continuous and <?'/(! — G) is 
bounded then f £ H2 implies <& t f G H2 for every t > and for every t > 0, the mapping from H_2 
to H_2 that takes v 1— > = ^(^f) is Lipschitz continuous. 

Proof. If is uniformly bounded, then Assumption [2] is trivially satisfied and 
G(x + y)- G{x + y) [* g(x + u) 1 - G(x + u) 

ficw = X i-g(x + U ) i-Gw ^^Mooly-yl. 

which shows that Assumption U is satisfied with Cq — and 7g = 1. 

Now, suppose that in addition, g is absolutely continuous and g' is either locally essentially 
bounded or g' e L 2 oc . If / = /(l - ' G)' 1 then /' = 7,(1 - G)" 1 + /i/ and /" = f xx (l ~ G)- 1 + 
2h{fx + fx) + fh 2 + /<?'(1 — G) -1 . Since g is absolutely continuous, / and /' and the first three 
terms in the expansion of /" are continuous with compact support and hence in L 2 oc . In addition, 
because /(l — G) -1 is continuous with compact support, the last term lies in L 2 oc if either g' is 
locally essentially bounded or, by Cauchy-Schwarz, if g' lies in L 2 oc . 

Now, suppose that g is absolutely continuous and g'/(l — G) is bounded. Fix t > and / £ H2. 
For notational conciseness, let 

rW = rtW = T^T' x£[0,L). 
Then, by the definition P~T5)| of $ t , for x £ [0, L), 
(*tf){x) = r(x)f(x + t), 
($tf)'(x) = r'(x)f(x + t)+r(x)f'(x + t), 
{<$>tf)"{x) = r"(x)f(x + t) + 2r'(x)f'(x + t)+r(x)f"(x + t). 

By the assumptions on g, if / £ H2 then $ t / has weak derivatives up to order two and elementary 
calculations show that 

- G{x + t))-(l- G(x))g(x + t) 
{l-G{x)f 



r'(x) = yW[1 ^ -} L ~ ^> mx I t; = r(x) - % + t)) 



+/(.t) - /i(x + i)) . 

Clearly, ||r|| < I and, due to the assumed boundedness of h and g'/(l — G), it follows that there 
exists G £ [l,oo) such that Wr'W^ < C and H^'Hoo — The above observations, when combined, 
show that 

||(*t/)|lL a < H/llL s <ll/lk. 
II(^/)'IIl 2 < V2C(\\f\\ L2 + \\f\\ L2 )<V2C\\f\\ B2 , 

||(*t/)"|| La < 4v^G(||/|| L2 + ||/'|| L2 + ||/"|| L2 )<4v^G||/|| H2 , 

which shows that H^t/Hjj < C ||/|| H2 for some finite constant G. This shows that $t/ £ H2 and 
that, for any t > 0, the map from H2 to H2 that takes / to $t/ is Lipschitz continuous (with 
constant G). This, in turn, trivially implies that for v £ H_2, the linear functional on H2 given by 
S v : f h- » v(Q t f) also lies in H_ 2 and that the map from H_ 2 to itself that takes v to 5" is also 
Lipschitz continuous with the same constant. This proves the second property and therefore the 
lemma. □ 
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Appendix C. Proof of the Representation Formula 

Fix N G N. We first show how (|6.15|) can be deduced from (|6.5j) : the proof of how to obtain 
(I6.14[) from (|6.1I) is analogous (in fact, a bit simpler), and is therefore omitted. Let (l be a set of 

full P-measure such that on Q, A {N \t), D (N \t), Q^\t) and K {N \t) arc finite for all t G [0,oo). 
Fix and let 7 and hp( N ' be the linear functionals on C c ([0, L) x [0, 00)) defined, respectively, 

by 

l(tp)= f ip(x,0)^ o N \dx)- f f <p(x,s)M iN \dx,ds)+ f tp(0,s)dK( N \s) 

and 



[0,L) J J J [0,oo) 

[0,i)x[0,< ~ 







for ip £ C c ([0, L) x [0, 00)). Since the total variation of Vq on [0, L) is bounded by 2y/N, the total 

variation of M { t N) (1) is bounded by VW [D^ (t) +A i f ) (i)) and the total variation of KW on [0, t] 

is bounded by \/N(K ' \t)+K(t)), for any tp G C c ([0, L) x [0, 00)) such that supp(i^) C [0, L) x [0, t], 
we have 

| 7 fo>)| < VN (2 + D (N) (t) + Ai N) (t) + K (N) (t) + K(t)) 
and, likewise, it can be argued that 



W^^)\<^y\\ oo (A[ N) (t) + A 1 (t)) 



This shows that 7 and hp( N ' define Radon measures on [0, L) x [0, 00). Let C^' 1 be the space of 
continuous functions with compact support on [0,L) x [0, 00) such that the directional derivative 
fx + fs exists and is continuous. Now, for every <p £ C*' , sending t — > 00 in (|6.5[) , the left-hand 
side of (|6.5I) vanishes because ip has compact support, and we obtain 

Since {i/f^i > 0} G T> M < 0>L \[0,oo), the last equation shows that {v[ N \t > 0} satisfies the so- 
called abstract age equation for 7, as introduced in Definition 4.9 of Kaspi and Ramanan [2"2"] . 
Therefore, by Corollary 4.17 and (4.24) of [35], it follows that for every / G C c [0,L), (f,V ( t N) ) = 
7(^3/), t > 0, where 

ip{(x,s) =ip^ 1 (x,s)f(x + t- s)ip h (x + t- s,t), (x,s) £ [0,L) x [0,t], 

where iph is the function defined in (4.53) of [22], and reproduced as equation (|9. 14|) of this paper. 
Elementary algebra (specifically combining the relations in (|9. 16[) with the definition (|4. 19|) of \& t ) 
then shows that <p{ (x, s) = 9 t f(x, s). For / G C c [0, L), the representation (|6.15[) is then obtained 
by expanding 7(\&t/) using the definition of 7 given above together with the relations (\l/ t /)(-, 0) = 
*t/, (*t/)(0, •) = /(t - - G(i - •)), = M ( t N) {V t f) and the definition (EHJ) of £W. 

Since the right-hand side of (|6.15l) is well defined for / £ Cb[0,L), a standard approximation 
argument can then be used to show that the representation (|6.15[) holds for / G Cb[0, L). 

Appendix D. Some Moment Estimates 
In this section, we prove the estimates stated in Lemma I5TT1 

Proof of Lemma [&71 Fix N £ N and T < 00 and, for conciseness, let Y^ N \s) = (R^\s), X^ N \s),V 
s £ [0,oo), represent the state process. Using the fact that M-^ = — A^ is a martingale 
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and taking expectations of both sides of the inequality (5.30) of Kaspi and Ramanan [22j . with t 
and 5 replaced by and T, respectively, it follows that 



(D.l) 



a?\t) 



-V'(o) 



'D iN) (T)] < U(T), 



where U is the renewal function associated with G. This shows that the inequality (|8.ip holds for 
k = 1. We proceed by induction. Suppose that (JSTTJ) holds with k = j — 1 for some integer j > 2. 
Then we can write 



(a[ n \t) 



(A ; ) 



((hri?)(hMjP)-..(hri 1 p)) d Sj ...d Sl 

((hMJP) ■■■{hrt? ) )) dsj...ds^ d Sl 
" ({h,vM) ■■■(hM s f ) )) d Sj ...ds 2 ) d Sl 



3-1 



ds±. 



Taking expectations of both sides above and applying Tonelli's theorem we obtain 



E y (N »(o) 



a[ n \t) 



- J 



(hM^)(Ai N \T)~A[ N \s,)) 



For each s\ G [0,T], due to the Markov property of Y N ^ established in Lemma B.l of Kang and 
Ramanan 120] we obtain 



E Y' N \o) 



{h ,V^)(A[ N \T)-A{ N \ Sl) ) 

(h^)(A N \T)-A ( f\ sl )y- 1 \^ 



Applying the induction assumption to the last term above, it follows that 

J- 1 ' 



^"1(0) 



(^^(^CD-^C-i))- 



< (j - 1)! W- 1 ^,^ (fc.PSf) 



Combining the last three displays, applying Tonelli's theorem again and using (|D. 1 1) . we obtain 



Ey(iV) (0) 



{a[ n \t) 



(h,V^)d Sl 



This shows that (|8.1j) is also satished for fc = j and hence, by induction, for all positive integers k. 

We now turn to the proof of the second bound. We can assume without loss of generality 
that ip*h is integrable on [0,L) because otherwise the inequality holds trivially. On substituting 
I = tp*h, ip = 1, r = and t = T in (5.31) of Proposition 5.7 of Kaspi and Ramanan [22], for every 
N G N, we have 



(D.2) 
where 



<% W(0) 



y$°(T)l <d(T) 



[0,L) 



</?* (x)h(x) dx , 



Ci(T) =su P E[X (Ar) (0) + S W (T)] < C(T) =sup sup E[X (A °(s) + E {N) (T)}, 

N N se[0,T] 
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which is finite by Theorem [321 Given (|D.2j) . the same inductive argument used in the proof of the 
first assertion of the lemma can then be used to complete the proof of the second bound. 

Next, note that if Assumptions [T] and [2] hold, then A^ => A± by Proposition 5.17 of [22] and 
A is continuous. Together with the Skorokhod representation theorem, Fatou's lemma and the 
inequality (jD.ll) . this implies that 



N- 



A\ (T) < lim inf E A\ ' (T) < limsupE A\ (T) <U(T) 



N- 



The inequality (|8.2[) can now be deduced from this inequality exactly as the inequality (18.1[) was 
deduced from the inequality (ID.1|) . though the proof is in fact much simpler because A± is deter- 
ministic. □ 

Appendix E. Proof of Consistency 
We first start by establishing some Fubini theorems. 

Lemma E.l. Let Assumptions]!^ be satisfied, let g be continuous and let ~H and JC be defined as 
in and J7.i?[ ), respectively. Suppose <p £ Cb([0,L) x [0,oo). Given the family of mappings 0t ; 

t > 0, defined in i8.21\) . we have 

(E.l) M t {Qt<p)= [ M r (*r(<P(;r))dr= f H r {<p(-,r)) dr. 

Jo Jo 

If, in addition, for every t £ [0,T], x t-¥ f (p(x,r) dr is bounded and Holder continuous, uniformly 
in t, then for every s > 0, almost surely for every t > 0, 

(E.2) M s (j *.(^(-,r)) dr^j = J M s {V s {(p{-,r)))dr = J^ H s (<p(-,r)) dr. 

Moreover, if either x i— > <p(x, r) is absolutely continuous for every r > and {x, r) i-> <p x (x, r)(l — 
G(x)) is locally integrable on [0, L) x [0, oo), or g is absolutely continuous and ip G C&([0, L) x [0, oo)) 7 
then almost surely, for every s, t > 0, 

(E.3) IC S (J $(.,r)dA = J*iC s (<p(;r))dr. 

Proof. Fix s,t > 0. Then 

(E.4) / *.(^(-,r))dr = *,(/ ^(-.rjjdr) 

Jo Jo 

and so, by the inequality (|4.20[) and the boundedness assumption on tp, J Q ^ s (ip(-, r)) dr and Oj<^ 
are uniformly bounded on [0, L) x [0, t). We can thus apply Fubini's theorem for stochastic integrals 
with respect to martingale measures (see Theorem 2.6 of [33]) to conclude that almost surely, (|E.1[) 
and (|E.2p are satisfied. We now have to show that the set of measure zero on which they are not 
satisfied is independent of t, for which it suffices to show that the processes on both sides of (jE.ll) 
and (|E.2|) are continuous in t. The processes on the right-hand sides of (|E.1[) and (|E.2[) are clearly 
continuous in t, whereas the continuity in t of the process on the left-hand side of (IE.1[) follows 
from property 4 of Lemma [5751 Because of ()E.4|) . the relation A^ S ( X I' S /) = H s (f) an d the assumed 
boundedness and uniform Holder continuity of x i— > /„ <p(x, r) dr, the continuity in t of the left- 
hand side of (|E.2|) follows from property 3 of Lemma 18.61 Thus, for any given s > there exists a 
set of full P-measure on which (|E.2[) and (|E. 1[) hold simultaneously for all t > 0. 
Next, by the definition of K, in (|7.2[) . note that IC s (Jg (p(-, r) dr) is equal to 



t \ rs a / pt 



p(u.r)dr) h'(s)+ I A"(u)^ ((1-G(x))tp(x,r)dr 



(I 



du. 
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By the stated assumptions, it follows that g is continuous and for each r > 0, the function x i— > 
(1 — G(x))cp(x, r) is absolutely continuous and its derivative (with respect to x) is locally integrable. 
Moreover, by Theorem 15. 6[ K is almost surely continuous and thus locally bounded. Thus, we 
can first exchange the order of differentiation and integration and then apply Fubini's theorem for 
Lebesgue integrals in the last display to conclude that /C S (J Q * <p(-,r) dr) is equal to 



t rs / ft 



;-((). ri/asSaY- / K( ii ) ( / ^L((i-G{x))Cp{x,r))\ x=s _ u dr) ,U, 



= J^ v(0,r)K( S )dr + jf ^ S £( M )^((l-G(o:))^(x,r))| x=s _ u ^ dr 

= / ^s(<p(-,r))dr, 
Jo 

which completes the proof of the lemma. □ 

We now prove the consistency lemma. 
Proof of Lemma \9.b\ Fix / G S and s, t > 0. Then, replacing £ by i + s in (|6.f 5j) . we obtain 



(E.5) = (/) - £g2(/) + 

Using the shift relations introduced in (|9.24[) (|9.26p . and recalling the definitions of W-^ and 
KS N > in (|4.14[) and (|6.f 2j) . respectively, the last two terms on the right-hand side of (|E.5I) can be 
decomposed as follows: 

(E.6) Hlll(f) = E ff ](f i+ J) = Mi N \% +s (f)) + (® s M {N) )(*tf), 



JC { t +!(f) = / f(s + t-u)(l-G(s + t-u))dK^\u) 



and, similarly, 



'[0,s+t] 

(E.7) = / /(a + t-ti)(l-G(a + t-u))dff (JV >(ti) 

-«))/(* -«)d(e.^W)(«). 

[0,t] 

On the other hand, since $ t / € C&[0, L), replacing / and Pq in (|6.15p by $i/ and pg , respec- 
tively, and using the semigroup property (|5.8p and the fact that ^s^t = ^ s +t on the appropriate 
domain as specified in (15.91) . we obtain 



s?° N) (f) = {$ t frt N) ) = 



+ / ($t/)( fl - u)(l - G(s - u)) d/ir< w >(u) 

i[0,s] 



(E.8) = sf t \f)-Mi N \* s+t f) 

+ [ f(s + t-u)(l-G(s + t-u))dk^(u). 

J[0,B] 

The relation (|9.29l) is then obtained by subtracting (|E.8I) from (|E.5I) , rearranging terms and using 
the relations (|E.7I) and (|E.6|) . 

Now, suppose that Assumptions HHU are satisfied and further, assume that g is continuous. Then 
Theorem 15.71 shows that the limit v of {lA 1 *'} is a continuous H_ 2 -valued process that is given 
explicitly by (|5.24l) . The shifted equation (|9.30[) for the limit v is proved in a similar fashion as 
for the corresponding quantity v^ N ^> in the iV-server system, except that now K. has the slightly 
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different representation ([7. 2p . We fili in the detaiis for completeness. Applying (|5.24p with t 
replaced by t + s, we see that for bounded and absolutely continuous /, 

v t+s {f) = S* s {f)-H t+s {f) + f{$)K{s)+ f + K(u)£ f (t + s-u)du. 



On the other hand, applying (|5.24[) with / and t, respectively, replaced by $ t / and s and using 
the semigroup relation (|5.8[) for $ t and the fact that ($ t /)(0) = f(t)(l — G(t)), we obtain 



(E.9) 



5 t ""(/) = vs{§tf) 



S% t (f) - M s (*t*tf) + f(t)(l - G(t))K(s) + / K(u)& tf (s - u) du 



Simple calculations show that £$ t / = £/(• + t). Hence, 

rt+s ^ i-8 ^ pt ^ 

/ K(u)(pf(t + s — u)du— / K(u)^ t f(s — u)du^ / K(s + u)£f(t — u) du 
Jo Jo Jo 

and, since £y = (/(l — G))', 

P - u) d« = /(0)£(«) - /(t)(l - G(t))tf(«). 

o 

Equation (|9.30l) can now be obtained by combining the last four equations with the limit analog 
of (|E.6[) , in which W N > and M^ N \ respectively, are replaced by T-L and M.. 

To show that (j9~5Tj) is satisfied, note that by Theorem lEol (K, X,v (l)) = A(E,x ,S v °{l) ~ 
%(!)). This implies that the centered many-server equations fl5.14[) — (|5.16[) are satisfied with 
v, Z,X,K and E, respectively, replaced by 9(1), S v "(l) - U(1),X,K and E. Fix any s > 0. 
Subtracting the equation (|5.15l) evaluated at t + s from the same equation evaluated at t, it follows 
that (|5.15[) also holds when K, E, X and v is replaced, respectively, by Q S K, Q S E, X s+ . and v a +. (1). 
It is also clear that (|5.16p is satisfied with v and X replaced by D s+t (l) and X s+t for all t > 0. 
Lastly, substituting / = 1 in (|9.30l) . using the definition (|9.27[) of S /C and the fact that ip± = —g, 
it follows that (|5.14[) holds with v,Z and K, respectively, replaced, by 9 S+ . (1), S Vs (1) — @ S %{1) 
and Q S K. This proves (|9"3T]) . 

Fix s > 0. We first need to show that Assumption [3] is satisfied when E^' and E, respectively, 
are replaced by Q S E^ N ' and Q S E. This is easily deduced using basic properties of renewal processes 
and Poisson processes and is thus left to the reader. Next, we show that Assumption [5j is satisfied 
when x N \ xq, Vq N \ and Vq, respectively, are replaced by X^ N \s), X(s), and v s . By definition 
(15.241) . v s {f) is a well defined random variable for all / G ACb[0,L) and, since $t/ G ACb[0,L) 
if / G ACb[0,L) it follows that S^'(f) = v s {§ t f) is also a well defined random variable for 
every / G -4Cfe[0, L). Now, due to (|5.24[) . the assumed measurability of / i-> S"°{f) and the 
joint measurability of the maps (s, /) n- M s (f) and (s, /) M> fC s (f) for / G Cfe[0, L), which is a 
consequence of the definition of these stochastic integrals, it follows that almost surely the map 
/ H> v s {f) from ACb[0,L) C Cf,[0, L) to R (both equipped with their respective Borel cr-algebras) 
is also measurable. Moreover, for a given ip G C&([0,L) x [0,T]) and t > 0, the maps r i-> $ r (/?(-,r) 
from [0,T] to Cf,[0,i) and / H> $t/ from Cf,[0, L) to itself are clearly also measurable (they are in 
fact continuous) . Since the composition of measurable maps is measurable, it follows that almost 
surely, both r h-> 9 s ($ r (<p(-, r))) and / H> S^ s (f) = z? s ($ t /) are measurable. 

In addition, due to the continuity of the limit in the convergence (|9.ip established in Proposition 
19.11 it follows that 

(i (ff) («), , e s £w , e s n (N) ) =>> (£(*), 9 S+ . , e s £, e s £) 

in the space K x £>h_ 2 [0, oo). In particular, this implies that v s has an H_2-valued version, and 
so property (a) of Assumption [5] is satisfied. Next, by (|9.29l) and (I9.30[) . S v ** can be expressed 
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as a linear combination of the H_2-valued processes , Q a K^ N \ OgW^) and, likewise, S" 3 is 
the same linear combination of {p a +., 6 S /C, Q a T-L). Therefore, the continuity of v s +-, ® a lC and Q s l-L 
show that S" s is a continuous H_ 2 -valued process. The same logic used above then shows that 
the real- valued process <S" S (1) is continuous and that the limits in property (c) of Assumption [5] 
holds. Thus, we have established that Assumption [5] continues to hold at a shifted time. 

It only remains to show that Assumption [5j is satisfied when vq is replaced by v a . Fix (p € 
Cb([0, L) x [0, oo)) such that x H> ip(x, r) is absolutely continuous and Holder continuous and ip x is 
integrable on [0, L) x [0, T] for any T < oo. We will make repeated use of the semigroup property 
& s o <I> r = $ s+r , the relation ^ s +r = ° on the appropriate domain as specified in (|5.9p . 
and the form (|7.2p of /C, without explicit mention. Then, by the other assumptions on h, for any 
r > 0, ^ r ip(-, r) and J Q $ r y>(-, r) dr are both bounded, Holder continuous and absolutely continuous 
functions on [0,L). Therefore, substituting / = & r ip(-,r) into (|5.24|) we see that 

(E.10) V.{*M;r)) = V {$ S +M;r)) - M a (*s+M;r)) +£ s ($M;r)). 

By (|5.11[) . it follows that Ph(<fr r) ) = Sf 3 (<§> r ip(-, r)). Furthermore, substituting / = J Q $ r </j(-,r) 

into (|5.24[) . invoking Assumption [SJ(d) with tp(-,r) replaced by $ s ip(- ) r), and applying the Fu- 
bini theorems (|E.2|) and (IE.3|) with the absolutely continuous and uniformly bounded function 

tp(x,r) — (3> r cp(-,r))(x), it follows that v s (f^ r (p(-,r)dr\ is equal to 

v ^ <f> a+r tp(;r)dr^J -M a ^ V a+r (cp(; r)) dr^j + K s (j^ <f> r <p(-,r)dr 

= [ v (®s+M-,r))dr - f M s {y s+r tp(-,r))dr + [ JC a ($ r <p(; r)) dr. 
Jo Jo Jo 

A comparison with (|E.10[) shows that the right-hand side above equals J Q v a ($> r (p(-, r)) dr. Thus, 
Assumption EJ(d) holds with vq replaced by v a . □ 
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